Jul 13 18:17:28.189988 ip-10-0-133-129 systemd[1]: Starting Kubernetes Kubelet... Jul 13 18:17:28.667373 ip-10-0-133-129 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 18:17:28.667373 ip-10-0-133-129 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 18:17:28.667373 ip-10-0-133-129 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 18:17:28.668068 ip-10-0-133-129 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 18:17:28.668068 ip-10-0-133-129 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 18:17:28.669558 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.669404 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 18:17:28.678407 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678379 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:17:28.678407 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678402 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:17:28.678407 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678407 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:17:28.678407 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678410 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:17:28.678407 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678413 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:17:28.678407 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678417 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678421 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678424 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678427 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678430 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678432 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678435 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678438 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678441 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678444 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678446 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678449 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678453 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678455 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678458 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678461 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678463 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678466 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678469 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678472 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:17:28.678653 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678475 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678477 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678480 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678483 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678486 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678488 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678491 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678494 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678497 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678500 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678502 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678507 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678512 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678516 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678520 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678523 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678525 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678528 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678531 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:17:28.679183 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678534 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678537 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678540 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678542 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678545 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678548 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678551 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678554 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678556 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678559 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678562 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678566 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678568 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678571 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678574 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678577 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678579 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678583 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678585 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678588 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:17:28.679700 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678591 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678594 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678596 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678599 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678602 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678605 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678608 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678612 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678614 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678617 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678620 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678622 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678625 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678628 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678631 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678635 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678640 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678643 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678646 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:17:28.680218 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678650 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678668 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678673 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678676 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678679 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678683 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678686 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678689 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678693 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678696 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678699 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678702 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678705 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678708 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678711 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.678714 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679509 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679517 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679520 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679524 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:17:28.680716 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679527 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679530 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679533 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679536 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679539 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679542 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679545 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679547 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679550 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679552 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679555 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679558 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679561 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679565 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679568 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679570 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679573 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679576 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679578 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679581 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:17:28.681207 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679584 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679586 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679589 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679592 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679596 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679600 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679603 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679606 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679610 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679613 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679616 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679619 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679622 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679625 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679628 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679631 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679633 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679636 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679639 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:17:28.681805 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679642 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679646 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679650 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679653 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679674 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679677 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679680 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679684 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679687 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679690 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679693 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679696 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679698 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679701 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679704 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679707 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679710 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679713 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679716 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679719 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:17:28.682296 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679722 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679726 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679729 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679732 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679735 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679739 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679743 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679745 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679748 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679751 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679754 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679756 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679759 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679762 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679764 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679768 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679771 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679774 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679777 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:17:28.682870 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679779 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679783 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679785 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679788 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679791 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679794 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679796 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679799 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679802 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679805 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679807 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679810 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679812 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679815 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679818 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679821 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.679823 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680229 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680234 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680237 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:17:28.683341 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680240 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680243 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680246 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680249 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680252 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680255 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680257 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680260 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680263 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680266 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680269 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680272 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680275 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680278 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680281 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680284 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680286 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680289 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680292 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680294 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:17:28.683884 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680297 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680300 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680302 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680305 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680307 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680311 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680315 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680318 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680321 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680324 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680326 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680329 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680332 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680335 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680337 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680340 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680343 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680345 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680348 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:17:28.684515 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680352 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680356 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680359 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680363 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680367 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680370 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680372 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680376 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680379 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680381 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680384 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680387 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680389 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680392 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680395 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680397 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680400 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680403 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680406 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680409 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:17:28.685021 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680411 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680414 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680417 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680420 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680423 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680425 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680428 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680430 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680433 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680436 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680438 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680441 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680444 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680446 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680449 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680453 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680456 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680459 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680462 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680464 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:17:28.685530 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680468 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680471 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680473 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680476 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680481 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680484 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680487 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680490 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680493 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680496 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680501 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680504 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680507 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680510 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680512 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680515 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.680517 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680593 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680600 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680607 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 18:17:28.686068 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680614 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680620 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680626 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680632 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680639 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680642 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680645 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680653 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680672 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680675 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680678 2565 flags.go:64] FLAG: --cgroup-root="" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680682 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680685 2565 flags.go:64] FLAG: --client-ca-file="" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680688 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680692 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680696 2565 flags.go:64] FLAG: --cluster-domain="" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680699 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680703 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680706 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680709 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680714 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680717 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680722 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 18:17:28.686587 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680726 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680729 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680733 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680736 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680739 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680742 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680746 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680750 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680753 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680756 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680759 2565 flags.go:64] FLAG: --enable-server="true" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680762 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680772 2565 flags.go:64] FLAG: --event-burst="100" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680776 2565 flags.go:64] FLAG: --event-qps="50" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680779 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680782 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680786 2565 flags.go:64] FLAG: --eviction-hard="" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680791 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680794 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680797 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680800 2565 flags.go:64] FLAG: --eviction-soft="" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680803 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680806 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680810 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680813 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 18:17:28.687176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680816 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680819 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680823 2565 flags.go:64] FLAG: --feature-gates="" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680827 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680830 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680833 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680838 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680841 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680845 2565 flags.go:64] FLAG: --help="false" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680847 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-133-129.ec2.internal" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680851 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680854 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680857 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680860 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680864 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680867 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680870 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680873 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680876 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680879 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680882 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680885 2565 flags.go:64] FLAG: --kube-reserved="" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680888 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680893 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 18:17:28.687853 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680896 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680899 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680902 2565 flags.go:64] FLAG: --lock-file="" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680905 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680908 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680912 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680917 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680921 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680924 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680927 2565 flags.go:64] FLAG: --logging-format="text" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680930 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680934 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680937 2565 flags.go:64] FLAG: --manifest-url="" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680940 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680951 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680954 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680959 2565 flags.go:64] FLAG: --max-pods="110" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680962 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680965 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680968 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680972 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680975 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680978 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680981 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680988 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 18:17:28.688475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680992 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680995 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.680998 2565 flags.go:64] FLAG: --pod-cidr="" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681001 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681007 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681010 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681013 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681018 2565 flags.go:64] FLAG: --port="10250" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681021 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681024 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08bf8d9a9ebde2e16" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681028 2565 flags.go:64] FLAG: --qos-reserved="" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681031 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681034 2565 flags.go:64] FLAG: --register-node="true" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681037 2565 flags.go:64] FLAG: --register-with-taints="" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681041 2565 flags.go:64] FLAG: --registry-burst="10" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681044 2565 flags.go:64] FLAG: --registry-qps="5" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681047 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681050 2565 flags.go:64] FLAG: --reserved-memory="" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681054 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681057 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681060 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681065 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681068 2565 flags.go:64] FLAG: --runonce="false" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681071 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681074 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 18:17:28.689128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681077 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681080 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681083 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681087 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681090 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681093 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681096 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681099 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681102 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681105 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681108 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681111 2565 flags.go:64] FLAG: --system-cgroups="" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681114 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681120 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681125 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681128 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681132 2565 flags.go:64] FLAG: --tls-min-version="" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681135 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681138 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681141 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681144 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681147 2565 flags.go:64] FLAG: --v="2" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681151 2565 flags.go:64] FLAG: --version="false" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681156 2565 flags.go:64] FLAG: --vmodule="" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681160 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 18:17:28.689791 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.681163 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681284 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681288 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681293 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681296 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681299 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681302 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681304 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681307 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681310 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681313 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681315 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681318 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681321 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681324 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681328 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681332 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681335 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681338 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:17:28.690445 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681341 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681344 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681348 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681351 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681353 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681356 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681359 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681362 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681365 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681368 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681370 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681373 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681376 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681379 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681382 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681385 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681388 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681391 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681394 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681397 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:17:28.691054 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681399 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681402 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681404 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681407 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681410 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681412 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681415 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681418 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681421 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681424 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681426 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681429 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681432 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681434 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681440 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681444 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681447 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681450 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681453 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681456 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:17:28.691573 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681459 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681463 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681468 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681470 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681474 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681478 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681481 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681483 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681487 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681490 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681493 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681496 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681499 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681502 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681504 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681507 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681510 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681513 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681515 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681518 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:17:28.692133 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681521 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681524 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681527 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681530 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681533 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681536 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681540 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681543 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681546 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681548 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681551 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681554 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681556 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681559 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681562 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681564 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681567 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681570 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681574 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681577 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:17:28.692647 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.681581 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.682386 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.689638 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.689654 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.690690 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.690701 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690764 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690770 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690774 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690777 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690781 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690784 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690787 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690791 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:17:28.693198 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690795 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690799 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690803 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690806 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690809 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690813 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690816 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690818 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690822 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690825 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690828 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690831 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690834 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690837 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690840 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690843 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690847 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690849 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690852 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690855 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:17:28.693568 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690858 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690862 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690865 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690868 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690871 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690873 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690877 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690879 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690882 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690885 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690888 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690890 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690893 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690896 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690899 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690901 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690904 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690907 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690910 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690912 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:17:28.694142 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690915 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690918 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690920 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690923 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690926 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690930 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690933 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690936 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690939 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690942 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690946 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690948 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690951 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690954 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690957 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690960 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690963 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690965 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690968 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690971 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:17:28.694745 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690973 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690976 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690979 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690982 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690984 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690987 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690990 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690992 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690995 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.690999 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691003 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691006 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691009 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691012 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691015 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691019 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691022 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691025 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691028 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:17:28.695257 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691032 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691036 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691039 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691043 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691046 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691050 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691053 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691056 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691059 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691062 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691065 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691068 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.691073 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691192 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691196 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 18:17:28.695757 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691199 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691202 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691205 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691208 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691211 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691213 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691216 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691219 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691222 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691225 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691227 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691230 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691233 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691236 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691238 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691243 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691246 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691250 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691253 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691256 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 18:17:28.696147 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691259 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691262 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691265 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691268 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691271 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691273 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691276 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691279 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691281 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691284 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691287 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691289 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691292 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691295 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691297 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691300 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691303 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691305 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691308 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691311 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 18:17:28.696683 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691313 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691316 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691319 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691321 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691324 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691327 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691329 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691333 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691336 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691338 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691341 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691344 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691348 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691352 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691356 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691359 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691363 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691366 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691369 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 18:17:28.697197 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691372 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691375 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691377 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691380 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691383 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691386 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691389 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691391 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691394 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691397 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691399 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691402 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691405 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691407 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691410 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691413 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691415 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691418 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691420 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691423 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 18:17:28.697698 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691426 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691429 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691431 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691434 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691437 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691440 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691443 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691446 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691450 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691454 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691457 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691461 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691464 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691467 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691470 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691472 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691475 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 18:17:28.698210 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:28.691478 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 18:17:28.698664 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.691484 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 18:17:28.698664 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.691588 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 18:17:28.698664 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.695119 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 18:17:28.698664 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.696819 2565 server.go:1019] "Starting client certificate rotation" Jul 13 18:17:28.698664 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.696930 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 18:17:28.698664 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.696966 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 18:17:28.701066 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.701050 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 18:17:28.705183 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.705160 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 18:17:28.720426 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.720405 2565 log.go:25] "Validated CRI v1 runtime API" Jul 13 18:17:28.722819 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.722799 2565 log.go:25] "Validated CRI v1 image API" Jul 13 18:17:28.723740 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.723724 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 18:17:28.726497 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.726476 2565 fs.go:135] Filesystem UUIDs: map[085eaf7f-cb15-42e3-8d4b-82301b8f49f3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 85f65c01-076a-47fb-a219-ffda18077b92:/dev/nvme0n1p4] Jul 13 18:17:28.726561 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.726496 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 18:17:28.728462 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.728445 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 18:17:28.732083 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.731962 2565 manager.go:216] Machine: {Timestamp:2026-07-13 18:17:28.73048307 +0000 UTC m=+0.402886894 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3051794 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec224685578ac619636ee9f1d8f99fde SystemUUID:ec224685-578a-c619-636e-e9f1d8f99fde BootID:64872188-8446-4f94-a766-9b13138a7d2d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:1d:83:38:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:1d:83:38:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:c6:07:3e:20:7a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 18:17:28.732083 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.732082 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 18:17:28.732200 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.732166 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 18:17:28.735761 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.735733 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 18:17:28.735904 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.735764 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 18:17:28.736689 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.736679 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 18:17:28.736726 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.736692 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 18:17:28.736726 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.736700 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 18:17:28.736726 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.736715 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 18:17:28.737836 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.737826 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 18:17:28.741890 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.741878 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 13 18:17:28.742013 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742003 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 18:17:28.742050 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742035 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 13 18:17:28.742050 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742050 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 18:17:28.742105 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742064 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 18:17:28.742105 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742073 2565 kubelet.go:398] "Adding apiserver pod source" Jul 13 18:17:28.742105 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742084 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 18:17:28.742528 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742514 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 18:17:28.742585 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.742536 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 18:17:28.745020 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.745003 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 18:17:28.746743 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.746726 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 18:17:28.746825 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.746767 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 18:17:28.747650 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747635 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 18:17:28.747738 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747676 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 18:17:28.747738 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747689 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 18:17:28.747738 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747698 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 18:17:28.747738 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747720 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 18:17:28.747738 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747729 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 18:17:28.747932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747742 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 18:17:28.747932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747750 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 18:17:28.747932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747761 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 18:17:28.747932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747769 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 18:17:28.747932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747791 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 18:17:28.747932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.747800 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 18:17:28.748761 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.748750 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 18:17:28.748814 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.748764 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 18:17:28.752161 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.752144 2565 server.go:1268] "Started kubelet" Jul 13 18:17:28.752280 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.752241 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 18:17:28.754605 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.754513 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 18:17:28.754679 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.754638 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 18:17:28.755660 ip-10-0-133-129 systemd[1]: Started Kubernetes Kubelet. Jul 13 18:17:28.756209 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.756119 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 18:17:28.758077 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.758060 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 13 18:17:28.759828 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.759799 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 18:17:28.759925 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.759832 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 18:17:28.760138 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.760115 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 18:17:28.760735 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.760716 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 18:17:28.763439 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.763418 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 18:17:28.763537 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.763440 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 18:17:28.763642 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.763621 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:28.764207 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.763056 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-129.ec2.internal.18c1ec3716038f8b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-129.ec2.internal,UID:ip-10-0-133-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-129.ec2.internal,},FirstTimestamp:2026-07-13 18:17:28.752115595 +0000 UTC m=+0.424519411,LastTimestamp:2026-07-13 18:17:28.752115595 +0000 UTC m=+0.424519411,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-129.ec2.internal,}" Jul 13 18:17:28.764356 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.764294 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 18:17:28.764356 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.764297 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 18:17:28.764356 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.764319 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 18:17:28.764510 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.764424 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 13 18:17:28.764510 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.764435 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 13 18:17:28.765125 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.765080 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 18:17:28.765125 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.765108 2565 factory.go:55] Registering systemd factory Jul 13 18:17:28.765125 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.765120 2565 factory.go:223] Registration of the systemd container factory successfully Jul 13 18:17:28.765357 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.765340 2565 factory.go:153] Registering CRI-O factory Jul 13 18:17:28.765403 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.765363 2565 factory.go:223] Registration of the crio container factory successfully Jul 13 18:17:28.765403 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.765390 2565 factory.go:103] Registering Raw factory Jul 13 18:17:28.765460 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.765407 2565 manager.go:1196] Started watching for new ooms in manager Jul 13 18:17:28.766097 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.766081 2565 manager.go:349] Starting recovery of all containers Jul 13 18:17:28.772115 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.772059 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 18:17:28.772515 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.772492 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 13 18:17:28.775355 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.775191 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rkbx8" Jul 13 18:17:28.776414 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.776399 2565 manager.go:354] Recovery completed Jul 13 18:17:28.778364 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.778336 2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 13 18:17:28.782858 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.782845 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:17:28.783597 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.783556 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rkbx8" Jul 13 18:17:28.784802 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.784784 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:17:28.784884 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.784818 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:17:28.784884 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.784832 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:17:28.785396 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.785379 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 18:17:28.785396 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.785394 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 18:17:28.785533 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.785412 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 13 18:17:28.785533 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.785378 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:17:28.786209 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.786188 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:17:28.786288 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.786221 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:17:28.786288 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.786233 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:17:28.786973 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.786962 2565 policy_none.go:49] "None policy: Start" Jul 13 18:17:28.787056 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.786978 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 18:17:28.787056 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.786992 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 18:17:28.787139 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.786999 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-129.ec2.internal.18c1ec3717f64d40 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-129.ec2.internal,UID:ip-10-0-133-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-129.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-129.ec2.internal,},FirstTimestamp:2026-07-13 18:17:28.784801088 +0000 UTC m=+0.457204903,LastTimestamp:2026-07-13 18:17:28.784801088 +0000 UTC m=+0.457204903,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-129.ec2.internal,}" Jul 13 18:17:28.788483 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.788469 2565 policy_none.go:47] "Start" Jul 13 18:17:28.831295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.831276 2565 manager.go:337] "Starting Device Plugin manager" Jul 13 18:17:28.831401 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.831313 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 18:17:28.831401 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.831328 2565 server.go:87] "Starting device plugin registration server" Jul 13 18:17:28.831678 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.831648 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 18:17:28.831678 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.831662 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 18:17:28.831837 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.831735 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 18:17:28.831837 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.831829 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 18:17:28.831837 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.831839 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 18:17:28.832429 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.832396 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 18:17:28.832515 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.832447 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:28.934197 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.934102 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:17:28.935779 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.935192 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:17:28.935779 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.935223 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:17:28.935779 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.935233 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:17:28.935779 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.935260 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-129.ec2.internal" Jul 13 18:17:28.950480 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.950456 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-129.ec2.internal" Jul 13 18:17:28.950589 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.950486 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-129.ec2.internal\": node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:28.985568 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.985530 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 18:17:28.986802 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.986775 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 18:17:28.986898 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.986813 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 18:17:28.986898 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.986835 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 18:17:28.986898 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.986870 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 18:17:28.987337 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:28.987303 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:28.992640 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:28.992621 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:17:29.088324 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.088284 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.088324 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.088304 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal"] Jul 13 18:17:29.088471 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.088378 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:17:29.090294 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.090279 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:17:29.090378 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.090310 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:17:29.090378 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.090321 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:17:29.092068 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.092055 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:17:29.092213 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.092199 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.092253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.092236 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:17:29.092949 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.092922 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:17:29.093044 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.092954 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:17:29.093044 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.092969 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:17:29.094814 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.094794 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:17:29.094902 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.094832 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:17:29.094902 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.094848 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:17:29.096543 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.096527 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.096596 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.096557 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 18:17:29.097783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.097759 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientMemory" Jul 13 18:17:29.097887 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.097792 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 18:17:29.097887 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.097806 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeHasSufficientPID" Jul 13 18:17:29.134430 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.134399 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-129.ec2.internal\" not found" node="ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.139403 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.139387 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-129.ec2.internal\" not found" node="ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.167341 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.167315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/918249503112faed70ef42f263320473-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"918249503112faed70ef42f263320473\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.167470 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.167347 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f7ba1521bdac6f9a0678ebd5382c9d2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"9f7ba1521bdac6f9a0678ebd5382c9d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.167470 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.167366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/918249503112faed70ef42f263320473-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"918249503112faed70ef42f263320473\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.189333 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.189277 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.267709 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.267673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f7ba1521bdac6f9a0678ebd5382c9d2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"9f7ba1521bdac6f9a0678ebd5382c9d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.267903 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.267735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/918249503112faed70ef42f263320473-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"918249503112faed70ef42f263320473\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.267903 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.267762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/918249503112faed70ef42f263320473-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"918249503112faed70ef42f263320473\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.267903 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.267793 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f7ba1521bdac6f9a0678ebd5382c9d2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-129.ec2.internal\" (UID: \"9f7ba1521bdac6f9a0678ebd5382c9d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.267903 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.267819 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/918249503112faed70ef42f263320473-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"918249503112faed70ef42f263320473\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.267903 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.267865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/918249503112faed70ef42f263320473-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal\" (UID: \"918249503112faed70ef42f263320473\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.289950 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.289920 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.391363 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.391329 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.440288 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.440214 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.443556 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.443535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:29.492308 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.492280 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.594352 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.594292 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.640559 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.640531 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:17:29.695287 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.695215 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.696404 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.696390 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 18:17:29.696535 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.696518 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 18:17:29.696579 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.696551 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 18:17:29.788807 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.788769 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 18:12:28 +0000 UTC" deadline="2028-01-09 06:59:26.621243688 +0000 UTC" Jul 13 18:17:29.788807 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:29.788798 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13068h41m56.832449045s" Jul 13 18:17:29.795379 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.795359 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.896428 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.896397 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:29.997322 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:29.997297 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:30.049088 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.049062 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:17:30.050617 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:30.050575 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918249503112faed70ef42f263320473.slice/crio-e12bacc2150484920de9ea651955f44a77e12801f0793866f919ae313a6b20c8 WatchSource:0}: Error finding container e12bacc2150484920de9ea651955f44a77e12801f0793866f919ae313a6b20c8: Status 404 returned error can't find the container with id e12bacc2150484920de9ea651955f44a77e12801f0793866f919ae313a6b20c8 Jul 13 18:17:30.055630 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.055592 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 18:17:30.097440 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.097414 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-129.ec2.internal\" not found" Jul 13 18:17:30.138441 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.138420 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:17:30.163712 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.163677 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" Jul 13 18:17:30.175513 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.175486 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 18:17:30.176639 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.176624 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" Jul 13 18:17:30.192796 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.192775 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 18:17:30.744142 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.744102 2565 apiserver.go:52] "Watching apiserver" Jul 13 18:17:30.751005 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.750980 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 18:17:30.751401 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.751381 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7nlvw","openshift-multus/multus-additional-cni-plugins-t5m68","openshift-multus/multus-bmsqx","openshift-multus/network-metrics-daemon-swrfq","openshift-network-operator/iptables-alerter-s488k","openshift-ovn-kubernetes/ovnkube-node-k7qtp","kube-system/global-pull-secret-syncer-mjq45","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6","openshift-dns/node-resolver-kwhbc","openshift-image-registry/node-ca-wfz9c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal","openshift-network-diagnostics/network-check-target-zc2x8","kube-system/konnectivity-agent-h4qfs","kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal"] Jul 13 18:17:30.753109 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.753084 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.753216 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.753172 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:30.754834 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.754812 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:30.756300 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.756277 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.756975 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.756953 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gmjts\"" Jul 13 18:17:30.757089 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.757071 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 18:17:30.757137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.757085 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 18:17:30.757991 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.757972 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:30.758091 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.758035 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:30.758091 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.758079 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 18:17:30.758617 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.758590 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 18:17:30.758823 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.758800 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 18:17:30.758894 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.758870 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 18:17:30.758964 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.758930 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4h2p7\"" Jul 13 18:17:30.759811 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.759791 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.761865 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.761844 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l6ccm\"" Jul 13 18:17:30.761963 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.761874 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 18:17:30.761963 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.761949 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 18:17:30.762115 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.762015 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 18:17:30.762327 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.762312 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.763727 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.763709 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 18:17:30.764387 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.764366 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.764598 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.764572 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbq5k\"" Jul 13 18:17:30.764771 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.764752 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 18:17:30.764838 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.764789 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 18:17:30.765993 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.765976 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 18:17:30.766399 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.765978 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 18:17:30.766554 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.766536 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 18:17:30.766986 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.766966 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 18:17:30.767777 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.767217 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bj77c\"" Jul 13 18:17:30.767777 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.767350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 18:17:30.768117 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.768101 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 18:17:30.768597 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.768563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.771442 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.771376 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 18:17:30.771442 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.771413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.771442 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.771398 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nvzc2\"" Jul 13 18:17:30.771883 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.771868 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 18:17:30.773206 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.773187 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.774000 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.773981 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 18:17:30.774095 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.774080 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 18:17:30.774199 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.774177 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hsljh\"" Jul 13 18:17:30.774337 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.774315 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 18:17:30.775003 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.774973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 18:17:30.775659 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.775640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.776010 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.775858 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lsqqx\"" Jul 13 18:17:30.776010 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.775896 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 18:17:30.776010 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.775996 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 18:17:30.776222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776053 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-dbus\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.776222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-etc-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.776222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776108 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-socket-dir-parent\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.776222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-k8s-cni-cncf-io\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.776222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-daemon-config\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.776222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776168 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc4ht\" (UniqueName: \"kubernetes.io/projected/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-kube-api-access-pc4ht\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.776222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8097181-e0f0-4857-b41e-1195f4fdebc2-agent-certs\") pod \"konnectivity-agent-h4qfs\" (UID: \"f8097181-e0f0-4857-b41e-1195f4fdebc2\") " pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776263 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-kubernetes\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776288 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysctl-conf\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776336 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-var-lib-kubelet\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-host\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776398 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-var-lib-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776447 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-conf-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776486 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2wkn\" (UniqueName: \"kubernetes.io/projected/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-kube-api-access-v2wkn\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysctl-d\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.776566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-run-netns\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-systemd\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776626 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmf6v\" (UniqueName: \"kubernetes.io/projected/5cd34880-0897-4dab-ad46-d66549cb2d8a-kube-api-access-hmf6v\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovnkube-config\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-os-release\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-run\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-cni-bin\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-cni-binary-copy\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64b6c96d-84a9-410c-be20-1e372521c064-host-slash\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-hostroot\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-etc-kubernetes\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776849 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776882 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-kubelet-config\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-node-log\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776924 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8097181-e0f0-4857-b41e-1195f4fdebc2-konnectivity-ca\") pod \"konnectivity-agent-h4qfs\" (UID: \"f8097181-e0f0-4857-b41e-1195f4fdebc2\") " pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776958 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-multus-certs\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.776988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.777251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-cni-bin\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-modprobe-d\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-env-overrides\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-system-cni-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777144 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-netns\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-kubelet\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-systemd\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-sys\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777235 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p25qp\" (UniqueName: \"kubernetes.io/projected/cd7599d9-277d-4b64-ba2e-37d53e71da3d-kube-api-access-p25qp\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-slash\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxdr4\" (UniqueName: \"kubernetes.io/projected/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-kube-api-access-sxdr4\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777314 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64b6c96d-84a9-410c-be20-1e372521c064-iptables-alerter-script\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777360 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-tmp-dir\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysconfig\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777405 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-kubelet\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-cni-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-cnibin\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.778121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-hosts-file\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777488 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-lib-modules\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777502 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-tuned\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-systemd-units\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-cni-netd\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-cni-multus\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mls9\" (UniqueName: \"kubernetes.io/projected/64b6c96d-84a9-410c-be20-1e372521c064-kube-api-access-6mls9\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd7599d9-277d-4b64-ba2e-37d53e71da3d-tmp\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovn-node-metrics-cert\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovnkube-script-lib\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-ovn\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777758 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-log-socket\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.777984 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8p2ng\"" Jul 13 18:17:30.778869 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.778416 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 18:17:30.779447 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.778899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:30.779447 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.778957 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:30.779447 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.779036 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 18:17:30.779447 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.779235 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 18:17:30.782943 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:30.782924 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7ba1521bdac6f9a0678ebd5382c9d2.slice/crio-de133c27ad865c609b6ae598447af27a5be60fd7bd3b36489f2503921b8ff181 WatchSource:0}: Error finding container de133c27ad865c609b6ae598447af27a5be60fd7bd3b36489f2503921b8ff181: Status 404 returned error can't find the container with id de133c27ad865c609b6ae598447af27a5be60fd7bd3b36489f2503921b8ff181 Jul 13 18:17:30.800295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.800273 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zl79p" Jul 13 18:17:30.809045 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.809026 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zl79p" Jul 13 18:17:30.869161 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.869107 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 18:17:30.878996 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.878972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-run\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.879137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-cni-bin\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.879137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-cni-binary-copy\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.879137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64b6c96d-84a9-410c-be20-1e372521c064-host-slash\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.879137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-hostroot\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.879137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-etc-kubernetes\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.879137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879110 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-run\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879163 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-cni-bin\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879169 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879115 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-hostroot\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-kubelet-config\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879275 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-etc-kubernetes\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879250 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/64b6c96d-84a9-410c-be20-1e372521c064-host-slash\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-node-log\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879320 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-kubelet-config\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879321 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-node-log\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-device-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8097181-e0f0-4857-b41e-1195f4fdebc2-konnectivity-ca\") pod \"konnectivity-agent-h4qfs\" (UID: \"f8097181-e0f0-4857-b41e-1195f4fdebc2\") " pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-multus-certs\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.879432 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879421 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld9x8\" (UniqueName: \"kubernetes.io/projected/b5a13c16-11b1-4300-bd5e-a305e2c2a881-kube-api-access-ld9x8\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879456 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-multus-certs\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-cni-bin\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-modprobe-d\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879512 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-cni-bin\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-env-overrides\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879564 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-system-cni-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-netns\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-kubelet\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-systemd\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879652 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-modprobe-d\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-sys\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-kubelet\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879694 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-netns\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879694 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-system-cni-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p25qp\" (UniqueName: \"kubernetes.io/projected/cd7599d9-277d-4b64-ba2e-37d53e71da3d-kube-api-access-p25qp\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879746 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-systemd\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879759 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-slash\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxdr4\" (UniqueName: \"kubernetes.io/projected/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-kube-api-access-sxdr4\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/857e09d3-4398-4d8c-8e77-5edbd13b3814-host\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879811 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-cni-binary-copy\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpnvn\" (UniqueName: \"kubernetes.io/projected/47b7fa7f-6080-48f6-9977-c8d5726700b1-kube-api-access-wpnvn\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879806 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-slash\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879866 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64b6c96d-84a9-410c-be20-1e372521c064-iptables-alerter-script\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879872 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-sys\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.879977 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-env-overrides\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880013 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-tmp-dir\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysconfig\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-kubelet\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880075 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f8097181-e0f0-4857-b41e-1195f4fdebc2-konnectivity-ca\") pod \"konnectivity-agent-h4qfs\" (UID: \"f8097181-e0f0-4857-b41e-1195f4fdebc2\") " pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880105 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-kubelet\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880114 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysconfig\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-cni-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-cnibin\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.880972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-hosts-file\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-lib-modules\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880249 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-tuned\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cnibin\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-tmp-dir\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880291 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-hosts-file\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880244 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-cni-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-systemd-units\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880352 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/64b6c96d-84a9-410c-be20-1e372521c064-iptables-alerter-script\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880362 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-cnibin\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-cni-netd\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880399 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-systemd-units\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-cni-multus\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880420 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-lib-modules\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880437 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mls9\" (UniqueName: \"kubernetes.io/projected/64b6c96d-84a9-410c-be20-1e372521c064-kube-api-access-6mls9\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-var-lib-cni-multus\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-cni-netd\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.881783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd7599d9-277d-4b64-ba2e-37d53e71da3d-tmp\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-os-release\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880544 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/857e09d3-4398-4d8c-8e77-5edbd13b3814-serviceca\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880690 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovn-node-metrics-cert\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovnkube-script-lib\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-ovn\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880935 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-ovn\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-log-socket\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.880999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgmf8\" (UniqueName: \"kubernetes.io/projected/857e09d3-4398-4d8c-8e77-5edbd13b3814-kube-api-access-zgmf8\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881079 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-log-socket\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-registration-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881200 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-dbus\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881219 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-etc-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.882624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-socket-dir-parent\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881261 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-k8s-cni-cncf-io\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-daemon-config\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc4ht\" (UniqueName: \"kubernetes.io/projected/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-kube-api-access-pc4ht\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-socket-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-sys-fs\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881331 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-dbus\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8097181-e0f0-4857-b41e-1195f4fdebc2-agent-certs\") pod \"konnectivity-agent-h4qfs\" (UID: \"f8097181-e0f0-4857-b41e-1195f4fdebc2\") " pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-kubernetes\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881394 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysctl-conf\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-var-lib-kubelet\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-host\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881489 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-var-lib-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.883492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-conf-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881532 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2wkn\" (UniqueName: \"kubernetes.io/projected/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-kube-api-access-v2wkn\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysctl-d\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-run-netns\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-systemd\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmf6v\" (UniqueName: \"kubernetes.io/projected/5cd34880-0897-4dab-ad46-d66549cb2d8a-kube-api-access-hmf6v\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881727 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-system-cni-dir\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovnkube-config\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-os-release\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881809 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-daemon-config\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881871 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-etc-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881929 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-os-release\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.881967 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.881972 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-kubernetes\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882026 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882065 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-conf-dir\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882074 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-var-lib-openvswitch\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882118 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-host-run-k8s-cni-cncf-io\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882168 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-multus-socket-dir-parent\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-run-systemd\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882232 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysctl-d\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.881973 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.882043 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs podName:4366c66f-0513-44fb-9d7e-3a4b72a84c2e nodeName:}" failed. No retries permitted until 2026-07-13 18:17:31.382022634 +0000 UTC m=+3.054426455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs") pod "network-metrics-daemon-swrfq" (UID: "4366c66f-0513-44fb-9d7e-3a4b72a84c2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882279 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5cd34880-0897-4dab-ad46-d66549cb2d8a-host-run-netns\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.882342 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret podName:fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f nodeName:}" failed. No retries permitted until 2026-07-13 18:17:31.382325345 +0000 UTC m=+3.054729163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret") pod "global-pull-secret-syncer-mjq45" (UID: "fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882356 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-sysctl-conf\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882363 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-host\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd7599d9-277d-4b64-ba2e-37d53e71da3d-var-lib-kubelet\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.882750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovnkube-config\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.883003 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovnkube-script-lib\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.883917 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd7599d9-277d-4b64-ba2e-37d53e71da3d-tmp\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.884513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cd34880-0897-4dab-ad46-d66549cb2d8a-ovn-node-metrics-cert\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.884650 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cd7599d9-277d-4b64-ba2e-37d53e71da3d-etc-tuned\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.884944 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.884758 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f8097181-e0f0-4857-b41e-1195f4fdebc2-agent-certs\") pod \"konnectivity-agent-h4qfs\" (UID: \"f8097181-e0f0-4857-b41e-1195f4fdebc2\") " pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:30.889048 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.889024 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mls9\" (UniqueName: \"kubernetes.io/projected/64b6c96d-84a9-410c-be20-1e372521c064-kube-api-access-6mls9\") pod \"iptables-alerter-s488k\" (UID: \"64b6c96d-84a9-410c-be20-1e372521c064\") " pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:30.889465 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.889297 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p25qp\" (UniqueName: \"kubernetes.io/projected/cd7599d9-277d-4b64-ba2e-37d53e71da3d-kube-api-access-p25qp\") pod \"tuned-7nlvw\" (UID: \"cd7599d9-277d-4b64-ba2e-37d53e71da3d\") " pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:30.889573 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.889549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxdr4\" (UniqueName: \"kubernetes.io/projected/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-kube-api-access-sxdr4\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:30.890783 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.890758 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2wkn\" (UniqueName: \"kubernetes.io/projected/c29ed7f7-dd99-41f5-9b16-b71d2ce2f556-kube-api-access-v2wkn\") pod \"multus-bmsqx\" (UID: \"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556\") " pod="openshift-multus/multus-bmsqx" Jul 13 18:17:30.890949 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.890930 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc4ht\" (UniqueName: \"kubernetes.io/projected/1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725-kube-api-access-pc4ht\") pod \"node-resolver-kwhbc\" (UID: \"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725\") " pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:30.891834 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.891814 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmf6v\" (UniqueName: \"kubernetes.io/projected/5cd34880-0897-4dab-ad46-d66549cb2d8a-kube-api-access-hmf6v\") pod \"ovnkube-node-k7qtp\" (UID: \"5cd34880-0897-4dab-ad46-d66549cb2d8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:30.982055 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/857e09d3-4398-4d8c-8e77-5edbd13b3814-host\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.982203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982059 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpnvn\" (UniqueName: \"kubernetes.io/projected/47b7fa7f-6080-48f6-9977-c8d5726700b1-kube-api-access-wpnvn\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.982203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cnibin\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.982203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.982203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-os-release\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.982203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.982203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/857e09d3-4398-4d8c-8e77-5edbd13b3814-serviceca\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.982203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982125 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/857e09d3-4398-4d8c-8e77-5edbd13b3814-host\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgmf8\" (UniqueName: \"kubernetes.io/projected/857e09d3-4398-4d8c-8e77-5edbd13b3814-kube-api-access-zgmf8\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-registration-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982345 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-socket-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-sys-fs\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982417 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982441 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-registration-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-system-cni-dir\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.982560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-device-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982577 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld9x8\" (UniqueName: \"kubernetes.io/projected/b5a13c16-11b1-4300-bd5e-a305e2c2a881-kube-api-access-ld9x8\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982635 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cnibin\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982732 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982794 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-cni-binary-copy\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982887 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982511 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-os-release\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982896 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-socket-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-sys-fs\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.982972 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-device-dir\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.983000 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/47b7fa7f-6080-48f6-9977-c8d5726700b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.983044 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b5a13c16-11b1-4300-bd5e-a305e2c2a881-system-cni-dir\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.983147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.983049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/857e09d3-4398-4d8c-8e77-5edbd13b3814-serviceca\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.983836 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.983377 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b5a13c16-11b1-4300-bd5e-a305e2c2a881-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.988717 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.988677 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:17:30.988717 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.988700 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:17:30.988717 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.988714 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wb6pc for pod openshift-network-diagnostics/network-check-target-zc2x8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:30.988949 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:30.988789 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc podName:6a21c63f-9efe-4bb3-bcb0-27bc13478027 nodeName:}" failed. No retries permitted until 2026-07-13 18:17:31.488771048 +0000 UTC m=+3.161174868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wb6pc" (UniqueName: "kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc") pod "network-check-target-zc2x8" (UID: "6a21c63f-9efe-4bb3-bcb0-27bc13478027") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:30.990271 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.990248 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgmf8\" (UniqueName: \"kubernetes.io/projected/857e09d3-4398-4d8c-8e77-5edbd13b3814-kube-api-access-zgmf8\") pod \"node-ca-wfz9c\" (UID: \"857e09d3-4398-4d8c-8e77-5edbd13b3814\") " pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:30.990494 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.990473 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld9x8\" (UniqueName: \"kubernetes.io/projected/b5a13c16-11b1-4300-bd5e-a305e2c2a881-kube-api-access-ld9x8\") pod \"multus-additional-cni-plugins-t5m68\" (UID: \"b5a13c16-11b1-4300-bd5e-a305e2c2a881\") " pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:30.991269 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.991248 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpnvn\" (UniqueName: \"kubernetes.io/projected/47b7fa7f-6080-48f6-9977-c8d5726700b1-kube-api-access-wpnvn\") pod \"aws-ebs-csi-driver-node-lc7z6\" (UID: \"47b7fa7f-6080-48f6-9977-c8d5726700b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:30.992466 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.992428 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" event={"ID":"9f7ba1521bdac6f9a0678ebd5382c9d2","Type":"ContainerStarted","Data":"de133c27ad865c609b6ae598447af27a5be60fd7bd3b36489f2503921b8ff181"} Jul 13 18:17:30.993524 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:30.993502 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"918249503112faed70ef42f263320473","Type":"ContainerStarted","Data":"e12bacc2150484920de9ea651955f44a77e12801f0793866f919ae313a6b20c8"} Jul 13 18:17:31.072553 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.072469 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:31.078205 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.078181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmsqx" Jul 13 18:17:31.082494 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.082470 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8097181_e0f0_4857_b41e_1195f4fdebc2.slice/crio-02f2d3300f1d2f87b6aa30635aea609811a28bb5edb5a74730009aa1503f923e WatchSource:0}: Error finding container 02f2d3300f1d2f87b6aa30635aea609811a28bb5edb5a74730009aa1503f923e: Status 404 returned error can't find the container with id 02f2d3300f1d2f87b6aa30635aea609811a28bb5edb5a74730009aa1503f923e Jul 13 18:17:31.087735 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.087716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s488k" Jul 13 18:17:31.092556 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.092539 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:31.099317 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.099301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kwhbc" Jul 13 18:17:31.106013 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.105996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" Jul 13 18:17:31.112667 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.112651 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t5m68" Jul 13 18:17:31.114804 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.114784 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:17:31.120040 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.120021 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfz9c" Jul 13 18:17:31.125040 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.125024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" Jul 13 18:17:31.385826 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.385730 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:31.385826 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.385786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:31.386059 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.385889 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:31.386059 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.385924 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:31.386059 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.385955 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret podName:fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f nodeName:}" failed. No retries permitted until 2026-07-13 18:17:32.385935667 +0000 UTC m=+4.058339491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret") pod "global-pull-secret-syncer-mjq45" (UID: "fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:31.386059 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.386006 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs podName:4366c66f-0513-44fb-9d7e-3a4b72a84c2e nodeName:}" failed. No retries permitted until 2026-07-13 18:17:32.38598655 +0000 UTC m=+4.058390355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs") pod "network-metrics-daemon-swrfq" (UID: "4366c66f-0513-44fb-9d7e-3a4b72a84c2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:31.396411 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.396368 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29ed7f7_dd99_41f5_9b16_b71d2ce2f556.slice/crio-9f8169766a8a64fef945790ef5c74da18a35416d944e4f42febbb928055e7ac7 WatchSource:0}: Error finding container 9f8169766a8a64fef945790ef5c74da18a35416d944e4f42febbb928055e7ac7: Status 404 returned error can't find the container with id 9f8169766a8a64fef945790ef5c74da18a35416d944e4f42febbb928055e7ac7 Jul 13 18:17:31.409932 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.409914 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b6c96d_84a9_410c_be20_1e372521c064.slice/crio-a9db54088a49142e9a241db1e08fbffaf90697f4b64103084eadf6523f6025d4 WatchSource:0}: Error finding container a9db54088a49142e9a241db1e08fbffaf90697f4b64103084eadf6523f6025d4: Status 404 returned error can't find the container with id a9db54088a49142e9a241db1e08fbffaf90697f4b64103084eadf6523f6025d4 Jul 13 18:17:31.427295 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.427270 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b7fa7f_6080_48f6_9977_c8d5726700b1.slice/crio-8cb2a071b167d5d293a2085a627109d3716d5e2214b21e450b0e93ace72b1263 WatchSource:0}: Error finding container 8cb2a071b167d5d293a2085a627109d3716d5e2214b21e450b0e93ace72b1263: Status 404 returned error can't find the container with id 8cb2a071b167d5d293a2085a627109d3716d5e2214b21e450b0e93ace72b1263 Jul 13 18:17:31.427869 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.427836 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod857e09d3_4398_4d8c_8e77_5edbd13b3814.slice/crio-cd065e8e21732c2302418e550225c50c0ec4217671b2c55315606884ea1f64b8 WatchSource:0}: Error finding container cd065e8e21732c2302418e550225c50c0ec4217671b2c55315606884ea1f64b8: Status 404 returned error can't find the container with id cd065e8e21732c2302418e550225c50c0ec4217671b2c55315606884ea1f64b8 Jul 13 18:17:31.429026 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.429004 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7e46ee_7d9b_4e13_8ee6_bba1c9e85725.slice/crio-921ad1d9eb7240ce8062b7061bc445811df82b4ff7497bf77bcd0faeaaa0e52d WatchSource:0}: Error finding container 921ad1d9eb7240ce8062b7061bc445811df82b4ff7497bf77bcd0faeaaa0e52d: Status 404 returned error can't find the container with id 921ad1d9eb7240ce8062b7061bc445811df82b4ff7497bf77bcd0faeaaa0e52d Jul 13 18:17:31.429863 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.429841 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd7599d9_277d_4b64_ba2e_37d53e71da3d.slice/crio-51041cc31ef0e284325aab1caa341463e0c03308f8cd2e2dc2913557b87a6dcc WatchSource:0}: Error finding container 51041cc31ef0e284325aab1caa341463e0c03308f8cd2e2dc2913557b87a6dcc: Status 404 returned error can't find the container with id 51041cc31ef0e284325aab1caa341463e0c03308f8cd2e2dc2913557b87a6dcc Jul 13 18:17:31.430642 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.430619 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a13c16_11b1_4300_bd5e_a305e2c2a881.slice/crio-0562e8f5c96bc890787239afedde2c1ee029e7a88f0c1c9c30cf13e7e76c005d WatchSource:0}: Error finding container 0562e8f5c96bc890787239afedde2c1ee029e7a88f0c1c9c30cf13e7e76c005d: Status 404 returned error can't find the container with id 0562e8f5c96bc890787239afedde2c1ee029e7a88f0c1c9c30cf13e7e76c005d Jul 13 18:17:31.431595 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:17:31.431559 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd34880_0897_4dab_ad46_d66549cb2d8a.slice/crio-55cce5d57b4ac632141b35a8798f451fdd35dd53d63da98fba7df4f8717d7e19 WatchSource:0}: Error finding container 55cce5d57b4ac632141b35a8798f451fdd35dd53d63da98fba7df4f8717d7e19: Status 404 returned error can't find the container with id 55cce5d57b4ac632141b35a8798f451fdd35dd53d63da98fba7df4f8717d7e19 Jul 13 18:17:31.587447 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.587242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:31.587447 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.587441 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:17:31.587688 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.587468 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:17:31.587688 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.587483 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wb6pc for pod openshift-network-diagnostics/network-check-target-zc2x8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:31.587688 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.587549 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc podName:6a21c63f-9efe-4bb3-bcb0-27bc13478027 nodeName:}" failed. No retries permitted until 2026-07-13 18:17:32.587529867 +0000 UTC m=+4.259933682 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb6pc" (UniqueName: "kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc") pod "network-check-target-zc2x8" (UID: "6a21c63f-9efe-4bb3-bcb0-27bc13478027") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:31.812729 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.812656 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:12:30 +0000 UTC" deadline="2028-02-08 21:45:42.606208696 +0000 UTC" Jul 13 18:17:31.812729 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.812720 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13803h28m10.793491147s" Jul 13 18:17:31.987993 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.987437 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:31.987993 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:31.987595 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:31.999933 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:31.999899 2565 generic.go:356] "Generic (PLEG): container finished" podID="918249503112faed70ef42f263320473" containerID="283895cd17fbf0768a763f2c634b40a6f2975957c33ae4c5c67f271a2d351e8d" exitCode=0 Jul 13 18:17:32.000470 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.000111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"918249503112faed70ef42f263320473","Type":"ContainerDied","Data":"283895cd17fbf0768a763f2c634b40a6f2975957c33ae4c5c67f271a2d351e8d"} Jul 13 18:17:32.002114 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.002004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"55cce5d57b4ac632141b35a8798f451fdd35dd53d63da98fba7df4f8717d7e19"} Jul 13 18:17:32.005024 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.004976 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerStarted","Data":"0562e8f5c96bc890787239afedde2c1ee029e7a88f0c1c9c30cf13e7e76c005d"} Jul 13 18:17:32.007480 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.007446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" event={"ID":"cd7599d9-277d-4b64-ba2e-37d53e71da3d","Type":"ContainerStarted","Data":"51041cc31ef0e284325aab1caa341463e0c03308f8cd2e2dc2913557b87a6dcc"} Jul 13 18:17:32.009179 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.009065 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfz9c" event={"ID":"857e09d3-4398-4d8c-8e77-5edbd13b3814","Type":"ContainerStarted","Data":"cd065e8e21732c2302418e550225c50c0ec4217671b2c55315606884ea1f64b8"} Jul 13 18:17:32.018865 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.018842 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" event={"ID":"47b7fa7f-6080-48f6-9977-c8d5726700b1","Type":"ContainerStarted","Data":"8cb2a071b167d5d293a2085a627109d3716d5e2214b21e450b0e93ace72b1263"} Jul 13 18:17:32.022476 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.022452 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s488k" event={"ID":"64b6c96d-84a9-410c-be20-1e372521c064","Type":"ContainerStarted","Data":"a9db54088a49142e9a241db1e08fbffaf90697f4b64103084eadf6523f6025d4"} Jul 13 18:17:32.028407 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.028384 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kwhbc" event={"ID":"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725","Type":"ContainerStarted","Data":"921ad1d9eb7240ce8062b7061bc445811df82b4ff7497bf77bcd0faeaaa0e52d"} Jul 13 18:17:32.033563 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.033541 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmsqx" event={"ID":"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556","Type":"ContainerStarted","Data":"9f8169766a8a64fef945790ef5c74da18a35416d944e4f42febbb928055e7ac7"} Jul 13 18:17:32.038476 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.038451 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4qfs" event={"ID":"f8097181-e0f0-4857-b41e-1195f4fdebc2","Type":"ContainerStarted","Data":"02f2d3300f1d2f87b6aa30635aea609811a28bb5edb5a74730009aa1503f923e"} Jul 13 18:17:32.396320 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.396228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:32.396320 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.396284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:32.396541 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.396433 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:32.396541 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.396493 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret podName:fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f nodeName:}" failed. No retries permitted until 2026-07-13 18:17:34.396476114 +0000 UTC m=+6.068879920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret") pod "global-pull-secret-syncer-mjq45" (UID: "fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:32.396920 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.396897 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:32.397007 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.396948 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs podName:4366c66f-0513-44fb-9d7e-3a4b72a84c2e nodeName:}" failed. No retries permitted until 2026-07-13 18:17:34.396934211 +0000 UTC m=+6.069338015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs") pod "network-metrics-daemon-swrfq" (UID: "4366c66f-0513-44fb-9d7e-3a4b72a84c2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:32.597429 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.597372 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:32.597648 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.597521 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:17:32.597648 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.597538 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:17:32.597648 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.597550 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wb6pc for pod openshift-network-diagnostics/network-check-target-zc2x8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:32.597648 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.597623 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc podName:6a21c63f-9efe-4bb3-bcb0-27bc13478027 nodeName:}" failed. No retries permitted until 2026-07-13 18:17:34.597605033 +0000 UTC m=+6.270008838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb6pc" (UniqueName: "kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc") pod "network-check-target-zc2x8" (UID: "6a21c63f-9efe-4bb3-bcb0-27bc13478027") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:32.816684 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.813564 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 18:12:30 +0000 UTC" deadline="2028-04-06 10:03:33.749041628 +0000 UTC" Jul 13 18:17:32.816684 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.813615 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15183h46m0.935430846s" Jul 13 18:17:32.880502 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.880472 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 18:17:32.988009 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.987964 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:32.988178 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.988118 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:32.988431 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:32.987977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:32.988431 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:32.988387 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:33.062046 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:33.062010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" event={"ID":"918249503112faed70ef42f263320473","Type":"ContainerStarted","Data":"fa7b9af9b1a3f0849b51a855223d823567ebdcb11780cb84abb797c3b1d69027"} Jul 13 18:17:33.987139 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:33.987086 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:33.987609 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:33.987225 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:34.412702 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:34.412611 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:34.412702 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:34.412672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:34.412930 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.412827 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:34.412930 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.412895 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret podName:fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f nodeName:}" failed. No retries permitted until 2026-07-13 18:17:38.412875623 +0000 UTC m=+10.085279428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret") pod "global-pull-secret-syncer-mjq45" (UID: "fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:34.413259 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.413231 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:34.413332 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.413303 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs podName:4366c66f-0513-44fb-9d7e-3a4b72a84c2e nodeName:}" failed. No retries permitted until 2026-07-13 18:17:38.413286975 +0000 UTC m=+10.085690793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs") pod "network-metrics-daemon-swrfq" (UID: "4366c66f-0513-44fb-9d7e-3a4b72a84c2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:34.614872 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:34.614838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:34.615055 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.615031 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:17:34.615055 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.615054 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:17:34.615169 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.615067 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wb6pc for pod openshift-network-diagnostics/network-check-target-zc2x8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:34.615169 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.615132 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc podName:6a21c63f-9efe-4bb3-bcb0-27bc13478027 nodeName:}" failed. No retries permitted until 2026-07-13 18:17:38.615113071 +0000 UTC m=+10.287516891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb6pc" (UniqueName: "kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc") pod "network-check-target-zc2x8" (UID: "6a21c63f-9efe-4bb3-bcb0-27bc13478027") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:34.988079 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:34.988039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:34.988517 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.988176 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:34.988819 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:34.988622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:34.988819 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:34.988742 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:35.987880 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:35.987845 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:35.988085 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:35.987985 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:36.990814 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:36.990785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:36.991236 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:36.990902 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:36.991236 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:36.990969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:36.991236 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:36.991035 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:37.987385 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:37.987341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:37.987568 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:37.987515 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:38.444771 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:38.444629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:38.444771 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:38.444670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:38.445206 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.444761 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:38.445206 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.444919 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs podName:4366c66f-0513-44fb-9d7e-3a4b72a84c2e nodeName:}" failed. No retries permitted until 2026-07-13 18:17:46.444894773 +0000 UTC m=+18.117298593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs") pod "network-metrics-daemon-swrfq" (UID: "4366c66f-0513-44fb-9d7e-3a4b72a84c2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:38.445319 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.444792 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:38.445319 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.445291 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret podName:fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f nodeName:}" failed. No retries permitted until 2026-07-13 18:17:46.445275335 +0000 UTC m=+18.117679139 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret") pod "global-pull-secret-syncer-mjq45" (UID: "fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:38.646960 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:38.646350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:38.646960 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.646513 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:17:38.646960 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.646533 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:17:38.646960 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.646546 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wb6pc for pod openshift-network-diagnostics/network-check-target-zc2x8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:38.646960 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.646619 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc podName:6a21c63f-9efe-4bb3-bcb0-27bc13478027 nodeName:}" failed. No retries permitted until 2026-07-13 18:17:46.646600846 +0000 UTC m=+18.319004648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb6pc" (UniqueName: "kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc") pod "network-check-target-zc2x8" (UID: "6a21c63f-9efe-4bb3-bcb0-27bc13478027") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:38.988954 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:38.988486 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:38.988954 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.988615 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:38.988954 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:38.988818 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:38.988954 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:38.988903 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:39.987422 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:39.987389 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:39.987886 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:39.987535 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:40.988129 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:40.987984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:40.988575 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:40.988137 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:40.988575 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:40.988186 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:40.988575 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:40.988290 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:41.987436 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:41.987395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:41.987643 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:41.987536 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:42.988004 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:42.987925 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:42.988418 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:42.987926 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:42.988418 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:42.988051 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:42.988418 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:42.988137 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:43.987239 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:43.987205 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:43.987395 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:43.987340 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:44.988013 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:44.987980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:44.988013 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:44.987996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:44.988507 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:44.988107 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:44.988507 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:44.988195 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:45.987206 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:45.987175 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:45.987447 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:45.987300 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:46.506374 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:46.506344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:46.506747 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:46.506407 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:46.506747 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.506487 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:46.506747 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.506543 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret podName:fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f nodeName:}" failed. No retries permitted until 2026-07-13 18:18:02.506528641 +0000 UTC m=+34.178932442 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret") pod "global-pull-secret-syncer-mjq45" (UID: "fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:17:46.506747 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.506492 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:46.506747 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.506620 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs podName:4366c66f-0513-44fb-9d7e-3a4b72a84c2e nodeName:}" failed. No retries permitted until 2026-07-13 18:18:02.506607989 +0000 UTC m=+34.179011790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs") pod "network-metrics-daemon-swrfq" (UID: "4366c66f-0513-44fb-9d7e-3a4b72a84c2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:17:46.707467 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:46.707433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:46.707656 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.707610 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:17:46.707656 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.707629 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:17:46.707656 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.707638 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wb6pc for pod openshift-network-diagnostics/network-check-target-zc2x8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:46.707773 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.707688 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc podName:6a21c63f-9efe-4bb3-bcb0-27bc13478027 nodeName:}" failed. No retries permitted until 2026-07-13 18:18:02.707671481 +0000 UTC m=+34.380075285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb6pc" (UniqueName: "kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc") pod "network-check-target-zc2x8" (UID: "6a21c63f-9efe-4bb3-bcb0-27bc13478027") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:17:46.988071 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:46.987988 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:46.988231 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.988121 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:46.988231 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:46.988151 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:46.988344 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:46.988267 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:47.987928 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:47.987887 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:47.988403 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:47.988041 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:48.988091 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:48.988007 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:48.988542 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:48.988130 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:48.988542 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:48.988197 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:48.988542 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:48.988318 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:49.987911 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:49.987876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:49.988089 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:49.988016 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:50.987448 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:50.987201 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:50.988040 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:50.987246 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:50.988040 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:50.987565 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:50.988040 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:50.987636 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:51.098065 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.098038 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" event={"ID":"9f7ba1521bdac6f9a0678ebd5382c9d2","Type":"ContainerStarted","Data":"7674eba44c51bb50d21a3dc4ed16c6a7a242d865d5254d262f01fb8119b3d6f1"} Jul 13 18:17:51.099309 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.099285 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kwhbc" event={"ID":"1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725","Type":"ContainerStarted","Data":"97261f48115dd33ebc0c028527a17b0488e4a09fa1f1398eb1ce641c093b9495"} Jul 13 18:17:51.100636 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.100617 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmsqx" event={"ID":"c29ed7f7-dd99-41f5-9b16-b71d2ce2f556","Type":"ContainerStarted","Data":"f06b7a4979f0ceb09b0d62949c87d1e6e2644aa676abcdbf490cf8ff1febaa26"} Jul 13 18:17:51.101918 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.101891 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4qfs" event={"ID":"f8097181-e0f0-4857-b41e-1195f4fdebc2","Type":"ContainerStarted","Data":"a0172e92dc42959d1cdf9b4555e78b0bcfff874d5965dbe314b2901bfe05def2"} Jul 13 18:17:51.103372 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.103353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:17:51.104529 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.104457 2565 generic.go:356] "Generic (PLEG): container finished" podID="5cd34880-0897-4dab-ad46-d66549cb2d8a" containerID="688f2cdbdb88697dbb34c754b5814df8971aa2debc51ae80b808dac555065ec4" exitCode=1 Jul 13 18:17:51.104644 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.104541 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"1d69b53942fc7eec73ade7b118f4baff00efbf02b38ea52fd569653e95802aff"} Jul 13 18:17:51.104714 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.104696 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerDied","Data":"688f2cdbdb88697dbb34c754b5814df8971aa2debc51ae80b808dac555065ec4"} Jul 13 18:17:51.105828 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.104785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"ae04824c80f071fd31107e1f8530ed7933ae1593c05130778b8b3648a8d9d238"} Jul 13 18:17:51.107968 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.107944 2565 generic.go:356] "Generic (PLEG): container finished" podID="b5a13c16-11b1-4300-bd5e-a305e2c2a881" containerID="aa0db630d88e51ebcf7f4c282b2a7a925083c78f9efadafcdc2eb084a15fcc32" exitCode=0 Jul 13 18:17:51.108055 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.108010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerDied","Data":"aa0db630d88e51ebcf7f4c282b2a7a925083c78f9efadafcdc2eb084a15fcc32"} Jul 13 18:17:51.109407 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.109380 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" event={"ID":"cd7599d9-277d-4b64-ba2e-37d53e71da3d","Type":"ContainerStarted","Data":"5dc0a3dadb7fd57e73c6a621159e1152ef6a76769e9c45fedb121133c4685c34"} Jul 13 18:17:51.110665 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.110641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfz9c" event={"ID":"857e09d3-4398-4d8c-8e77-5edbd13b3814","Type":"ContainerStarted","Data":"8b93052967780ad6a97ba68495d014039bfad1a398f1b4f107bf223169e53c33"} Jul 13 18:17:51.111868 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.111852 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" event={"ID":"47b7fa7f-6080-48f6-9977-c8d5726700b1","Type":"ContainerStarted","Data":"e803d220d9899160d2ef50245dd6e4eeebae09571feabadc3efe700f41899c6f"} Jul 13 18:17:51.124360 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.124314 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-129.ec2.internal" podStartSLOduration=21.124303742 podStartE2EDuration="21.124303742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:33.090092885 +0000 UTC m=+4.762496708" watchObservedRunningTime="2026-07-13 18:17:51.124303742 +0000 UTC m=+22.796707564" Jul 13 18:17:51.153518 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.153480 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kwhbc" podStartSLOduration=2.900211525 podStartE2EDuration="22.153469738s" totalImagesPullingTime="19.253258213s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:51.15309053 +0000 UTC m=+22.825494352" watchObservedRunningTime="2026-07-13 18:17:51.153469738 +0000 UTC m=+22.825873559" Jul 13 18:17:51.153665 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.153646 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-129.ec2.internal" podStartSLOduration=21.153641714 podStartE2EDuration="21.153641714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:51.123917039 +0000 UTC m=+22.796320861" watchObservedRunningTime="2026-07-13 18:17:51.153641714 +0000 UTC m=+22.826045537" Jul 13 18:17:51.177213 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.177153 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h4qfs" podStartSLOduration=2.577177539 podStartE2EDuration="22.177141859s" totalImagesPullingTime="19.59996432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:51.17707953 +0000 UTC m=+22.849483354" watchObservedRunningTime="2026-07-13 18:17:51.177141859 +0000 UTC m=+22.849545682" Jul 13 18:17:51.264044 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.264002 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7nlvw" podStartSLOduration=2.990079619 podStartE2EDuration="22.263986456s" totalImagesPullingTime="19.273906837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:51.213137263 +0000 UTC m=+22.885541086" watchObservedRunningTime="2026-07-13 18:17:51.263986456 +0000 UTC m=+22.936390316" Jul 13 18:17:51.281465 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.281341 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wfz9c" podStartSLOduration=3.029889395 podStartE2EDuration="22.281325024s" totalImagesPullingTime="19.251435629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:51.280774453 +0000 UTC m=+22.953178279" watchObservedRunningTime="2026-07-13 18:17:51.281325024 +0000 UTC m=+22.953728846" Jul 13 18:17:51.300002 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.299962 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bmsqx" podStartSLOduration=2.9562609970000002 podStartE2EDuration="22.299948107s" totalImagesPullingTime="19.34368711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:51.299535338 +0000 UTC m=+22.971939160" watchObservedRunningTime="2026-07-13 18:17:51.299948107 +0000 UTC m=+22.972351929" Jul 13 18:17:51.671467 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.671432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:51.837793 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.837756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:51.987085 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:51.987057 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:51.987237 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:51.987200 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:52.066652 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.066616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:52.116928 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.116903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:17:52.117429 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.117404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"30973a2e1b100bbd74f00f3cdffaf365caa2d6e4c67cbd6569ad49925059c87e"} Jul 13 18:17:52.117526 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.117490 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"0d2f0fc37b453e4228d48dd0c4f3d09a452b7e44920788ac32893da6d34add0b"} Jul 13 18:17:52.117601 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.117542 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"a815cc126bcab288af4eafabd77a5f9c24ee2cd79fa6f64807a14fd16bf19e19"} Jul 13 18:17:52.118981 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.118953 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s488k" event={"ID":"64b6c96d-84a9-410c-be20-1e372521c064","Type":"ContainerStarted","Data":"43fd2c26ab291ae6e48cb8bcd9f1d7b8203d1e9b42d6303e363149b284e5e0f9"} Jul 13 18:17:52.214256 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.214193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:52.310976 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.310872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:52.588393 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.588284 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:52.589226 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.589195 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:52.704510 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.704483 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kwhbc_1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725/dns-node-resolver/0.log" Jul 13 18:17:52.988090 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.988018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:52.988231 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:52.988018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:52.988231 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:52.988149 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:52.988231 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:52.988192 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:53.154755 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.154704 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s488k" podStartSLOduration=4.895558092 podStartE2EDuration="24.154689738s" totalImagesPullingTime="19.259131646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:53.1544789 +0000 UTC m=+24.826882716" watchObservedRunningTime="2026-07-13 18:17:53.154689738 +0000 UTC m=+24.827093560" Jul 13 18:17:53.196092 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.196053 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 18:17:53.252674 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.252595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:53.535914 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.535883 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:53.635331 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.635284 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:53.705539 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.705509 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfz9c_857e09d3-4398-4d8c-8e77-5edbd13b3814/node-ca/0.log" Jul 13 18:17:53.808811 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.808779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:53.844293 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.844202 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T18:17:53.19607213Z","UUID":"a8723005-d899-4772-b0ce-6c619c44882e","Handler":null,"Name":"","Endpoint":""} Jul 13 18:17:53.845785 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.845632 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 18:17:53.845903 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.845806 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 18:17:53.916675 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.916624 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:53.987863 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:53.987831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:53.988037 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:53.987979 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:54.018216 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.018187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:54.126562 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.126488 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:17:54.127007 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.126977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"37d19e3519b81ba6f1be7f20b1a41f064335fbfc0dcafa6a5659bcc79dc4e356"} Jul 13 18:17:54.128909 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.128887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" event={"ID":"47b7fa7f-6080-48f6-9977-c8d5726700b1","Type":"ContainerStarted","Data":"5eaf9b90dedacddd1f44e9c231878fc340222c14cc49c4b71efb441af8b3ec5a"} Jul 13 18:17:54.129033 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.128928 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 13 18:17:54.129864 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.129846 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:54.313838 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.313805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:54.474632 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.474535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:54.987317 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.987288 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:54.987530 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:54.987416 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:54.987530 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:54.987464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:54.987670 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:54.987604 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:55.067079 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:55.067044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:55.212556 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:55.212521 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:55.625245 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:55.625214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:55.987653 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:55.987627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:55.987758 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:55.987727 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:56.048068 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.047769 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:56.136308 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.136271 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" event={"ID":"47b7fa7f-6080-48f6-9977-c8d5726700b1","Type":"ContainerStarted","Data":"98eb57fc3f5f26bafe0cfd711e4dd8b23f66c9e7a9ec7adcf0f245379e9473fc"} Jul 13 18:17:56.139774 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.139673 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:17:56.140094 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.140072 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"ccc32d08b1fe94cf65443099e01f93fb3975c9d8a67537e5c1054fc5c962b7de"} Jul 13 18:17:56.140311 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.140291 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:56.140503 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.140489 2565 scope.go:117] "RemoveContainer" containerID="688f2cdbdb88697dbb34c754b5814df8971aa2debc51ae80b808dac555065ec4" Jul 13 18:17:56.142173 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.142139 2565 generic.go:356] "Generic (PLEG): container finished" podID="b5a13c16-11b1-4300-bd5e-a305e2c2a881" containerID="8f4d1f228b0cf28f899f1a9bb296ce91184465ced97abd650a01a4a7f9d14dc6" exitCode=0 Jul 13 18:17:56.142276 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.142189 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerDied","Data":"8f4d1f228b0cf28f899f1a9bb296ce91184465ced97abd650a01a4a7f9d14dc6"} Jul 13 18:17:56.157128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.157076 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lc7z6" podStartSLOduration=3.043754818 podStartE2EDuration="27.157057443s" totalImagesPullingTime="24.113302625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:56.156630282 +0000 UTC m=+27.829034108" watchObservedRunningTime="2026-07-13 18:17:56.157057443 +0000 UTC m=+27.829461267" Jul 13 18:17:56.158669 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.158648 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:56.628358 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.628323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:56.729510 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.729477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:56.987262 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.987232 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:56.987431 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:56.987354 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:56.987431 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:56.987399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:56.987509 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:56.987480 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:57.041854 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.041823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:57.149301 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.149232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:17:57.149682 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.149639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" event={"ID":"5cd34880-0897-4dab-ad46-d66549cb2d8a","Type":"ContainerStarted","Data":"d187414110dad4ab1b578f304c0d210880025848c619053be3537638c48ca769"} Jul 13 18:17:57.150095 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.150074 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:57.150219 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.150149 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:57.167607 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.167571 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:17:57.189307 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.189267 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" podStartSLOduration=8.867221354 podStartE2EDuration="28.189253846s" totalImagesPullingTime="19.322032492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:17:57.18849422 +0000 UTC m=+28.860898055" watchObservedRunningTime="2026-07-13 18:17:57.189253846 +0000 UTC m=+28.861657668" Jul 13 18:17:57.650612 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.650568 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:57.720363 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.720285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:57.845742 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.845714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:57.978955 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.978876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:57.987624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:57.987600 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:57.987760 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:57.987699 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:17:58.153411 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.153378 2565 generic.go:356] "Generic (PLEG): container finished" podID="b5a13c16-11b1-4300-bd5e-a305e2c2a881" containerID="b1927601415475b09b138055fb0e3f061efb2af6f35898752eb45ed77564c6a7" exitCode=0 Jul 13 18:17:58.153572 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.153465 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerDied","Data":"b1927601415475b09b138055fb0e3f061efb2af6f35898752eb45ed77564c6a7"} Jul 13 18:17:58.394228 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.394193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:58.472601 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.472548 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:58.472770 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.472719 2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 13 18:17:58.473207 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.473188 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h4qfs" Jul 13 18:17:58.637376 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.637318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:58.728788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.728681 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:58.988744 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.988673 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:17:58.988881 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:58.988755 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:17:58.988881 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:58.988772 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:17:58.988881 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:58.988853 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:17:59.018080 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:59.018049 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:59.418863 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:59.418831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:59.614951 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:59.614916 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:17:59.987351 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:17:59.987276 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:17:59.987719 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:17:59.987376 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:00.018164 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.018133 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:00.153523 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.153489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:00.159293 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.159268 2565 generic.go:356] "Generic (PLEG): container finished" podID="b5a13c16-11b1-4300-bd5e-a305e2c2a881" containerID="49d8f2cdc72f3d1f19a60d08f59df982fef0486cc8c9296e3d766424b2cbf5e9" exitCode=0 Jul 13 18:18:00.159421 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.159315 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerDied","Data":"49d8f2cdc72f3d1f19a60d08f59df982fef0486cc8c9296e3d766424b2cbf5e9"} Jul 13 18:18:00.614603 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.614560 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:00.987186 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.987090 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:00.987351 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:00.987200 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:00.987351 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.987239 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:00.987351 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:00.987309 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:00.999481 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:00.999454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:01.100174 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:01.100142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:01.213102 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:01.213064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:01.618365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:01.618330 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:01.823483 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:01.823453 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:01.987358 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:01.987284 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:01.987518 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:01.987407 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:02.405878 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.405677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:02.523251 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.523216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:02.523442 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.523257 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:02.523442 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.523382 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 18:18:02.523442 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.523386 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:18:02.523626 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.523450 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret podName:fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f nodeName:}" failed. No retries permitted until 2026-07-13 18:18:34.523433459 +0000 UTC m=+66.195837274 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret") pod "global-pull-secret-syncer-mjq45" (UID: "fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f") : object "kube-system"/"original-pull-secret" not registered Jul 13 18:18:02.523626 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.523474 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs podName:4366c66f-0513-44fb-9d7e-3a4b72a84c2e nodeName:}" failed. No retries permitted until 2026-07-13 18:18:34.52346093 +0000 UTC m=+66.195864730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs") pod "network-metrics-daemon-swrfq" (UID: "4366c66f-0513-44fb-9d7e-3a4b72a84c2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 18:18:02.724035 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.723947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:02.724181 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.724098 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 18:18:02.724181 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.724119 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 18:18:02.724181 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.724128 2565 projected.go:196] Error preparing data for projected volume kube-api-access-wb6pc for pod openshift-network-diagnostics/network-check-target-zc2x8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:18:02.724181 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.724177 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc podName:6a21c63f-9efe-4bb3-bcb0-27bc13478027 nodeName:}" failed. No retries permitted until 2026-07-13 18:18:34.724164128 +0000 UTC m=+66.396567932 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wb6pc" (UniqueName: "kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc") pod "network-check-target-zc2x8" (UID: "6a21c63f-9efe-4bb3-bcb0-27bc13478027") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 18:18:02.782000 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.781968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:02.850440 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.850405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:02.987282 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.987189 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:02.987282 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:02.987244 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:02.987511 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.987326 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:02.987576 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:02.987532 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:03.626511 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:03.626475 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:03.987091 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:03.987021 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:03.987243 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:03.987155 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:04.014515 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:04.014485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:04.220203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:04.220171 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:04.409077 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:04.409045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:04.631470 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:04.631435 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:04.987426 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:04.987341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:04.987615 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:04.987341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:04.987615 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:04.987453 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:04.987615 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:04.987508 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:05.172788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:05.172754 2565 generic.go:356] "Generic (PLEG): container finished" podID="b5a13c16-11b1-4300-bd5e-a305e2c2a881" containerID="5327495b896ebeda3d774ffca6cbb895cca4da4112c838f3b9b9b6cf58a21a7a" exitCode=0 Jul 13 18:18:05.173212 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:05.172810 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerDied","Data":"5327495b896ebeda3d774ffca6cbb895cca4da4112c838f3b9b9b6cf58a21a7a"} Jul 13 18:18:05.455941 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:05.455911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:05.987265 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:05.987233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:05.987437 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:05.987335 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:06.177780 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:06.177751 2565 generic.go:356] "Generic (PLEG): container finished" podID="b5a13c16-11b1-4300-bd5e-a305e2c2a881" containerID="ce25a5b606fdc4f2ad42192968e626f9aa1f9f2295629ae0ed5168acc7c48e1e" exitCode=0 Jul 13 18:18:06.178127 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:06.177795 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerDied","Data":"ce25a5b606fdc4f2ad42192968e626f9aa1f9f2295629ae0ed5168acc7c48e1e"} Jul 13 18:18:06.987733 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:06.987701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:06.987904 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:06.987745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:06.987904 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:06.987819 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:06.987987 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:06.987916 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:07.184969 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:07.184933 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t5m68" event={"ID":"b5a13c16-11b1-4300-bd5e-a305e2c2a881","Type":"ContainerStarted","Data":"d30b8124aa20af0f94687695d3b98df77fd24f8895ae68a0502c277b673e7225"} Jul 13 18:18:07.212570 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:07.212524 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t5m68" podStartSLOduration=7.425383527 podStartE2EDuration="38.212508883s" totalImagesPullingTime="30.787125356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:07.212194983 +0000 UTC m=+38.884598828" watchObservedRunningTime="2026-07-13 18:18:07.212508883 +0000 UTC m=+38.884912706" Jul 13 18:18:07.580760 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:07.580729 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:07.682462 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:07.682436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:07.794561 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:07.794530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:07.874246 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:07.874176 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:07.987316 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:07.987281 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:07.987486 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:07.987385 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:08.235627 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.235531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:08.301746 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.301718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:08.433086 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.433056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:08.528613 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.528523 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:08.661794 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.661747 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:08.726535 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.726506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:08.988461 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.988432 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:08.988628 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:08.988507 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:08.988628 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:08.988612 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:08.988735 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:08.988656 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:09.271280 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:09.271204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:09.396370 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:09.396337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:09.497692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:09.497662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:09.598407 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:09.598382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:09.987828 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:09.987758 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:09.987961 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:09.987859 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:10.510470 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:10.510433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:10.615530 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:10.615498 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:10.987676 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:10.987644 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:10.987850 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:10.987739 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:10.987850 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:10.987796 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:10.987924 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:10.987877 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:11.987773 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:11.987749 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:11.988151 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:11.987841 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:12.987493 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:12.987453 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:12.987493 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:12.987497 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:12.987719 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:12.987603 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:12.987719 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:12.987691 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:13.680047 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:13.679998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:13.818443 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:13.818413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:13.903948 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:13.903917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:13.987690 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:13.987618 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:13.987837 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:13.987721 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:14.982807 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:14.982773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:14.987615 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:14.987576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:14.987728 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:14.987692 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:14.987770 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:14.987744 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:14.987847 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:14.987831 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:15.078753 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:15.078709 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:15.319274 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:15.319236 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zc2x8"] Jul 13 18:18:15.319465 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:15.319396 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:15.319533 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:15.319495 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:15.320055 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:15.320028 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mjq45"] Jul 13 18:18:15.320271 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:15.320131 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:15.320271 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:15.320235 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:15.320816 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:15.320778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-swrfq"] Jul 13 18:18:15.320915 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:15.320881 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:15.321004 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:15.320983 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:16.987267 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:16.987072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:16.987889 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:16.987072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:16.987889 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:16.987346 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:16.987889 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:16.987118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:16.987889 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:16.987416 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:16.987889 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:16.987483 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:17.915058 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:17.915029 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:17.991601 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:17.991562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:18.679987 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:18.679951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:18.789038 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:18.789011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:18.988572 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:18.988494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:18.988739 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:18.988578 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mjq45" podUID="fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f" Jul 13 18:18:18.988739 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:18.988685 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:18.988839 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:18.988816 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-swrfq" podUID="4366c66f-0513-44fb-9d7e-3a4b72a84c2e" Jul 13 18:18:18.988898 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:18.988866 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:18.988991 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:18.988973 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zc2x8" podUID="6a21c63f-9efe-4bb3-bcb0-27bc13478027" Jul 13 18:18:19.393447 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.393415 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-129.ec2.internal" event="NodeReady" Jul 13 18:18:19.393932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.393563 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 18:18:19.443524 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.443486 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w8bx9"] Jul 13 18:18:19.465595 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.465550 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lckkx"] Jul 13 18:18:19.465753 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.465698 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.468498 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.468478 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zjxc8\"" Jul 13 18:18:19.468666 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.468499 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 18:18:19.468728 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.468714 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 18:18:19.489687 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.489656 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w8bx9"] Jul 13 18:18:19.489838 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.489700 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lckkx"] Jul 13 18:18:19.489838 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.489732 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lnn7b"] Jul 13 18:18:19.489838 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.489777 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.493439 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.493415 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zzhjh\"" Jul 13 18:18:19.493561 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.493483 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 18:18:19.493561 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.493497 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 18:18:19.493728 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.493690 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 18:18:19.493789 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.493733 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 18:18:19.513838 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.513814 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnn7b"] Jul 13 18:18:19.513936 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.513899 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.516314 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.516295 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rvwwf\"" Jul 13 18:18:19.516425 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.516300 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 18:18:19.516521 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.516507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 18:18:19.516627 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.516608 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 18:18:19.554325 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stdpr\" (UniqueName: \"kubernetes.io/projected/89cabab7-0554-4a9a-9ad5-080e910a2919-kube-api-access-stdpr\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.554423 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554327 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-tmp-dir\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.554423 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d8d63e-f925-42f7-9669-dedec032d8c2-cert\") pod \"ingress-canary-lnn7b\" (UID: \"f4d8d63e-f925-42f7-9669-dedec032d8c2\") " pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.554423 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6lc5\" (UniqueName: \"kubernetes.io/projected/f4d8d63e-f925-42f7-9669-dedec032d8c2-kube-api-access-d6lc5\") pod \"ingress-canary-lnn7b\" (UID: \"f4d8d63e-f925-42f7-9669-dedec032d8c2\") " pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.554523 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28zc5\" (UniqueName: \"kubernetes.io/projected/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-kube-api-access-28zc5\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.554523 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-config-volume\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.554523 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-metrics-tls\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.554523 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89cabab7-0554-4a9a-9ad5-080e910a2919-crio-socket\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.554672 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89cabab7-0554-4a9a-9ad5-080e910a2919-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.554672 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89cabab7-0554-4a9a-9ad5-080e910a2919-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.554672 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.554617 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89cabab7-0554-4a9a-9ad5-080e910a2919-data-volume\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.590792 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.590760 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:19.647242 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.647163 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:19.655156 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-tmp-dir\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.655253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d8d63e-f925-42f7-9669-dedec032d8c2-cert\") pod \"ingress-canary-lnn7b\" (UID: \"f4d8d63e-f925-42f7-9669-dedec032d8c2\") " pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.655253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6lc5\" (UniqueName: \"kubernetes.io/projected/f4d8d63e-f925-42f7-9669-dedec032d8c2-kube-api-access-d6lc5\") pod \"ingress-canary-lnn7b\" (UID: \"f4d8d63e-f925-42f7-9669-dedec032d8c2\") " pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.655253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28zc5\" (UniqueName: \"kubernetes.io/projected/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-kube-api-access-28zc5\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.655405 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655279 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-config-volume\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.655452 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-metrics-tls\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.655502 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89cabab7-0554-4a9a-9ad5-080e910a2919-crio-socket\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.655552 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89cabab7-0554-4a9a-9ad5-080e910a2919-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.655692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89cabab7-0554-4a9a-9ad5-080e910a2919-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.655692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655635 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-tmp-dir\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.655692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/89cabab7-0554-4a9a-9ad5-080e910a2919-crio-socket\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.655845 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89cabab7-0554-4a9a-9ad5-080e910a2919-data-volume\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.655845 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stdpr\" (UniqueName: \"kubernetes.io/projected/89cabab7-0554-4a9a-9ad5-080e910a2919-kube-api-access-stdpr\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.655984 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.655965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-config-volume\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.656054 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.656025 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/89cabab7-0554-4a9a-9ad5-080e910a2919-data-volume\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.656203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.656176 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/89cabab7-0554-4a9a-9ad5-080e910a2919-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.659224 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.659202 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/89cabab7-0554-4a9a-9ad5-080e910a2919-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.659320 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.659243 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-metrics-tls\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.659320 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.659274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d8d63e-f925-42f7-9669-dedec032d8c2-cert\") pod \"ingress-canary-lnn7b\" (UID: \"f4d8d63e-f925-42f7-9669-dedec032d8c2\") " pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.663365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.663340 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stdpr\" (UniqueName: \"kubernetes.io/projected/89cabab7-0554-4a9a-9ad5-080e910a2919-kube-api-access-stdpr\") pod \"insights-runtime-extractor-lckkx\" (UID: \"89cabab7-0554-4a9a-9ad5-080e910a2919\") " pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.663463 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.663453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6lc5\" (UniqueName: \"kubernetes.io/projected/f4d8d63e-f925-42f7-9669-dedec032d8c2-kube-api-access-d6lc5\") pod \"ingress-canary-lnn7b\" (UID: \"f4d8d63e-f925-42f7-9669-dedec032d8c2\") " pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.663780 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.663757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28zc5\" (UniqueName: \"kubernetes.io/projected/cde58b71-8ef9-41f1-9f4e-cb047fe19fd9-kube-api-access-28zc5\") pod \"dns-default-w8bx9\" (UID: \"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9\") " pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.775538 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.775502 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:19.798686 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.798655 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lckkx" Jul 13 18:18:19.821365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.821348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lnn7b" Jul 13 18:18:19.988864 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:19.988829 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:20.001619 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.001426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lnn7b"] Jul 13 18:18:20.004786 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.004757 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lckkx"] Jul 13 18:18:20.005706 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.005688 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w8bx9"] Jul 13 18:18:20.006419 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:20.006400 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d8d63e_f925_42f7_9669_dedec032d8c2.slice/crio-7355d968cd9c879f530fc33142d15c2b1712cace15f8d330203209574acd2036 WatchSource:0}: Error finding container 7355d968cd9c879f530fc33142d15c2b1712cace15f8d330203209574acd2036: Status 404 returned error can't find the container with id 7355d968cd9c879f530fc33142d15c2b1712cace15f8d330203209574acd2036 Jul 13 18:18:20.007783 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:20.007727 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde58b71_8ef9_41f1_9f4e_cb047fe19fd9.slice/crio-d2736ceeb6884f2dbb3cd21f94fcf4363cbe050b78104d456ebd10e8d5ddcc83 WatchSource:0}: Error finding container d2736ceeb6884f2dbb3cd21f94fcf4363cbe050b78104d456ebd10e8d5ddcc83: Status 404 returned error can't find the container with id d2736ceeb6884f2dbb3cd21f94fcf4363cbe050b78104d456ebd10e8d5ddcc83 Jul 13 18:18:20.009151 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:20.009135 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89cabab7_0554_4a9a_9ad5_080e910a2919.slice/crio-4b0eb176965ce3c3df73ada109d415bf69cc577afbd0f55a776f6be398b4ddb3 WatchSource:0}: Error finding container 4b0eb176965ce3c3df73ada109d415bf69cc577afbd0f55a776f6be398b4ddb3: Status 404 returned error can't find the container with id 4b0eb176965ce3c3df73ada109d415bf69cc577afbd0f55a776f6be398b4ddb3 Jul 13 18:18:20.089369 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.089315 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:20.212384 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.212305 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnn7b" event={"ID":"f4d8d63e-f925-42f7-9669-dedec032d8c2","Type":"ContainerStarted","Data":"7355d968cd9c879f530fc33142d15c2b1712cace15f8d330203209574acd2036"} Jul 13 18:18:20.213396 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.213372 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lckkx" event={"ID":"89cabab7-0554-4a9a-9ad5-080e910a2919","Type":"ContainerStarted","Data":"4b0eb176965ce3c3df73ada109d415bf69cc577afbd0f55a776f6be398b4ddb3"} Jul 13 18:18:20.214299 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.214281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8bx9" event={"ID":"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9","Type":"ContainerStarted","Data":"d2736ceeb6884f2dbb3cd21f94fcf4363cbe050b78104d456ebd10e8d5ddcc83"} Jul 13 18:18:20.275137 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.275112 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64895f784c-bv6ss"] Jul 13 18:18:20.283520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.283488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:20.307784 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.307753 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64895f784c-bv6ss"] Jul 13 18:18:20.307924 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.307840 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.316536 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.316515 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 13 18:18:20.316647 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.316624 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 13 18:18:20.316647 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.316630 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 13 18:18:20.316741 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.316631 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 13 18:18:20.317393 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.317377 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-th76q\"" Jul 13 18:18:20.317393 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.317386 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 13 18:18:20.317498 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.317480 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 13 18:18:20.317988 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.317973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 13 18:18:20.322233 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.322217 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 13 18:18:20.362042 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.362019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-oauth-config\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.362133 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.362047 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz85b\" (UniqueName: \"kubernetes.io/projected/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-kube-api-access-bz85b\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.362171 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.362130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-serving-cert\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.362171 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.362154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-config\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.362232 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.362173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-trusted-ca-bundle\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.362232 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.362208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-oauth-serving-cert\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.362294 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.362240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-service-ca\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.463420 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.463336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-service-ca\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.463420 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.463391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-oauth-config\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.463420 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.463416 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz85b\" (UniqueName: \"kubernetes.io/projected/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-kube-api-access-bz85b\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.463977 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.463480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-serving-cert\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.463977 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.463504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-config\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.463977 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.463526 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-trusted-ca-bundle\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.463977 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.463550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-oauth-serving-cert\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.464172 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.464112 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-service-ca\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.464738 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.464719 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-oauth-serving-cert\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.465348 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.465321 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-config\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.465459 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.465437 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-trusted-ca-bundle\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.466784 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.466764 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-oauth-config\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.466930 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.466913 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-serving-cert\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.471885 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.471861 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz85b\" (UniqueName: \"kubernetes.io/projected/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-kube-api-access-bz85b\") pod \"console-64895f784c-bv6ss\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.616600 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.616524 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:20.788042 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.787788 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64895f784c-bv6ss"] Jul 13 18:18:20.792804 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:20.792778 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8102fcc_0ccb_4ba5_8c17_00920e98f39a.slice/crio-9ef28c545ccb428c78bd8527251db6075cffe28e678f0ddbb278d3f458221dfa WatchSource:0}: Error finding container 9ef28c545ccb428c78bd8527251db6075cffe28e678f0ddbb278d3f458221dfa: Status 404 returned error can't find the container with id 9ef28c545ccb428c78bd8527251db6075cffe28e678f0ddbb278d3f458221dfa Jul 13 18:18:20.988546 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.987799 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:20.988546 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.988464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:20.988781 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.988635 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:20.990790 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.990730 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 18:18:20.990937 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.990817 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 18:18:20.991764 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.991371 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 18:18:20.991764 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.991410 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqlm7\"" Jul 13 18:18:20.991764 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.991450 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j9kl2\"" Jul 13 18:18:20.991764 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:20.991611 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 18:18:21.219017 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:21.218977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64895f784c-bv6ss" event={"ID":"a8102fcc-0ccb-4ba5-8c17-00920e98f39a","Type":"ContainerStarted","Data":"9ef28c545ccb428c78bd8527251db6075cffe28e678f0ddbb278d3f458221dfa"} Jul 13 18:18:22.884076 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:22.884039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:22.991776 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:22.990137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:23.088748 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.088716 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz"] Jul 13 18:18:23.091181 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.091161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:23.142608 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.142511 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz"] Jul 13 18:18:23.142744 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.142621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:23.144985 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.144961 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 13 18:18:23.145141 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.145022 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vwb6t\"" Jul 13 18:18:23.186758 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.186729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-8jlgz\" (UID: \"2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:23.287859 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.287823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-8jlgz\" (UID: \"2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:23.288040 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:23.287987 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 13 18:18:23.288107 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:23.288047 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4-tls-certificates podName:2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4 nodeName:}" failed. No retries permitted until 2026-07-13 18:18:23.788031481 +0000 UTC m=+55.460435283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-8jlgz" (UID: "2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4") : secret "prometheus-operator-admission-webhook-tls" not found Jul 13 18:18:23.428718 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.428576 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:23.518925 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.518885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:23.791994 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.791960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-8jlgz\" (UID: \"2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:23.796973 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:23.796846 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-8jlgz\" (UID: \"2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:24.051800 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:24.051719 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:24.259839 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:24.259805 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:24.362228 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:24.362112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:24.465075 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:24.465047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:25.613204 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:25.613177 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:25.636806 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:25.636772 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz"] Jul 13 18:18:26.180957 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:26.180922 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a10e4ef_ef2d_4c3e_b506_bb3a06b310e4.slice/crio-b179250aa258b58dc7410e378454cf1e6dee2a5a5fd09dee3d1f70ae0655f5ee WatchSource:0}: Error finding container b179250aa258b58dc7410e378454cf1e6dee2a5a5fd09dee3d1f70ae0655f5ee: Status 404 returned error can't find the container with id b179250aa258b58dc7410e378454cf1e6dee2a5a5fd09dee3d1f70ae0655f5ee Jul 13 18:18:26.233742 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:26.233709 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lnn7b" event={"ID":"f4d8d63e-f925-42f7-9669-dedec032d8c2","Type":"ContainerStarted","Data":"0fac007883da29e8d078801533c77df4f1c441f816b8f7f7323eb04b026155df"} Jul 13 18:18:26.235009 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:26.234978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" event={"ID":"2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4","Type":"ContainerStarted","Data":"b179250aa258b58dc7410e378454cf1e6dee2a5a5fd09dee3d1f70ae0655f5ee"} Jul 13 18:18:26.260700 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:26.260644 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lnn7b" podStartSLOduration=1.783930628 podStartE2EDuration="7.260618371s" totalImagesPullingTime="5.476687743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:26.260082376 +0000 UTC m=+57.932486194" watchObservedRunningTime="2026-07-13 18:18:26.260618371 +0000 UTC m=+57.933022198" Jul 13 18:18:26.298489 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:26.298430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:26.399554 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:26.399505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:28.245910 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:28.245822 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lckkx" event={"ID":"89cabab7-0554-4a9a-9ad5-080e910a2919","Type":"ContainerStarted","Data":"3af4f54cda959a5db87d223c59f19b11c743f6754ca459f9defcd035c33e9838"} Jul 13 18:18:28.247994 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:28.247968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8bx9" event={"ID":"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9","Type":"ContainerStarted","Data":"cc139b305cc23562f87d7c8285317583ef2f210073361eff2aa26ee13ff1bf82"} Jul 13 18:18:28.248125 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:28.248014 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8bx9" event={"ID":"cde58b71-8ef9-41f1-9f4e-cb047fe19fd9","Type":"ContainerStarted","Data":"5df14ab986598fb6715a4068c369b2e41d2d71c989b33e934c46f64e2ef57f7b"} Jul 13 18:18:28.248125 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:28.248085 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:28.249832 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:28.249811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64895f784c-bv6ss" event={"ID":"a8102fcc-0ccb-4ba5-8c17-00920e98f39a","Type":"ContainerStarted","Data":"f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1"} Jul 13 18:18:28.267239 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:28.267175 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w8bx9" podStartSLOduration=1.554886401 podStartE2EDuration="9.267159309s" totalImagesPullingTime="7.712272908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:28.266139042 +0000 UTC m=+59.938542866" watchObservedRunningTime="2026-07-13 18:18:28.267159309 +0000 UTC m=+59.939563109" Jul 13 18:18:28.286809 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:28.286762 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64895f784c-bv6ss" podStartSLOduration=1.355710326 podStartE2EDuration="8.286743639s" totalImagesPullingTime="6.931033313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:28.285665465 +0000 UTC m=+59.958069289" watchObservedRunningTime="2026-07-13 18:18:28.286743639 +0000 UTC m=+59.959147466" Jul 13 18:18:29.157411 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.157372 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:29.167352 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.167324 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k7qtp" Jul 13 18:18:29.256219 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.256175 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" event={"ID":"2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4","Type":"ContainerStarted","Data":"6cefa99bb4b3bd97eb5e52604659b6c1effc44123556f218fdb9dfab5a748e28"} Jul 13 18:18:29.256694 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.256379 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:29.259087 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.259042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lckkx" event={"ID":"89cabab7-0554-4a9a-9ad5-080e910a2919","Type":"ContainerStarted","Data":"b9b4412debca3e4a3e2c6e4ba739291e65a7ed4254cf0b27c84d6ab8753e68de"} Jul 13 18:18:29.261533 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.261490 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:29.262316 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.262296 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" Jul 13 18:18:29.275907 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.275870 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-8jlgz" podStartSLOduration=4.049901378 podStartE2EDuration="6.275855302s" totalImagesPullingTime="2.225953924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:29.275477452 +0000 UTC m=+60.947881276" watchObservedRunningTime="2026-07-13 18:18:29.275855302 +0000 UTC m=+60.948259127" Jul 13 18:18:29.364745 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.364706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:29.456663 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.456569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:29.895214 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:29.895179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:30.001430 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.001400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:30.135164 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.135126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:30.181554 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.181458 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4jq5n"] Jul 13 18:18:30.185014 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.184996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.187443 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.187422 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 13 18:18:30.187556 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.187422 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 13 18:18:30.188312 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.188286 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 18:18:30.188412 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.188321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nkltr\"" Jul 13 18:18:30.188612 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.188574 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 18:18:30.188720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.188574 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 18:18:30.197742 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.197721 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4jq5n"] Jul 13 18:18:30.236848 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.236812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:30.243928 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.243899 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.244064 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.243940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3157ec82-1ebe-4daf-9f0c-225a70239f18-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.244064 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.244019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8nqx\" (UniqueName: \"kubernetes.io/projected/3157ec82-1ebe-4daf-9f0c-225a70239f18-kube-api-access-m8nqx\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.244156 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.244070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.345212 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.345173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.345212 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.345213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3157ec82-1ebe-4daf-9f0c-225a70239f18-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.345751 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.345536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8nqx\" (UniqueName: \"kubernetes.io/projected/3157ec82-1ebe-4daf-9f0c-225a70239f18-kube-api-access-m8nqx\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.345751 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.345622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.345751 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:30.345747 2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 13 18:18:30.345970 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:30.345804 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-tls podName:3157ec82-1ebe-4daf-9f0c-225a70239f18 nodeName:}" failed. No retries permitted until 2026-07-13 18:18:30.845784574 +0000 UTC m=+62.518188377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-tls") pod "prometheus-operator-64785b6675-4jq5n" (UID: "3157ec82-1ebe-4daf-9f0c-225a70239f18") : secret "prometheus-operator-tls" not found Jul 13 18:18:30.346281 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.346253 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3157ec82-1ebe-4daf-9f0c-225a70239f18-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.347899 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.347876 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.358294 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.358270 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8nqx\" (UniqueName: \"kubernetes.io/projected/3157ec82-1ebe-4daf-9f0c-225a70239f18-kube-api-access-m8nqx\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.472896 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.472811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:30.617211 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.617177 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:30.617410 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.617275 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:30.623310 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.623287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:30.850541 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.850485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:30.853183 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:30.853152 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3157ec82-1ebe-4daf-9f0c-225a70239f18-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4jq5n\" (UID: \"3157ec82-1ebe-4daf-9f0c-225a70239f18\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:31.095326 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:31.095299 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" Jul 13 18:18:31.230090 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:31.230061 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4jq5n"] Jul 13 18:18:31.233137 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:31.233110 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3157ec82_1ebe_4daf_9f0c_225a70239f18.slice/crio-cdaef6f13961210dd375c9190092601e764ba09b8bd98a27351fbf1f61dbfc94 WatchSource:0}: Error finding container cdaef6f13961210dd375c9190092601e764ba09b8bd98a27351fbf1f61dbfc94: Status 404 returned error can't find the container with id cdaef6f13961210dd375c9190092601e764ba09b8bd98a27351fbf1f61dbfc94 Jul 13 18:18:31.266833 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:31.266801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" event={"ID":"3157ec82-1ebe-4daf-9f0c-225a70239f18","Type":"ContainerStarted","Data":"cdaef6f13961210dd375c9190092601e764ba09b8bd98a27351fbf1f61dbfc94"} Jul 13 18:18:31.268795 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:31.268770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lckkx" event={"ID":"89cabab7-0554-4a9a-9ad5-080e910a2919","Type":"ContainerStarted","Data":"c29c9a43c9e86b555bce7821ea42d54460647a74d648ef339fd476946814757c"} Jul 13 18:18:31.273300 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:31.273280 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:18:31.289821 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:31.289766 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lckkx" podStartSLOduration=1.438664838 podStartE2EDuration="12.289748211s" totalImagesPullingTime="10.851083373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:18:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:31.289191355 +0000 UTC m=+62.961595179" watchObservedRunningTime="2026-07-13 18:18:31.289748211 +0000 UTC m=+62.962152032" Jul 13 18:18:32.684100 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:32.684035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:32.784355 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:32.784323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:33.166901 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:33.166796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:33.277744 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:33.277711 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" event={"ID":"3157ec82-1ebe-4daf-9f0c-225a70239f18","Type":"ContainerStarted","Data":"9ed954e93ac655d9521efb3ae5b585d4a3e02061009bd53f784ae90b9bbdb49d"} Jul 13 18:18:33.277914 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:33.277765 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" event={"ID":"3157ec82-1ebe-4daf-9f0c-225a70239f18","Type":"ContainerStarted","Data":"c316f9870711dea36abb17421c781aa660fd9cb09ba3d1b7481b357e77dbd902"} Jul 13 18:18:33.291028 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:33.291000 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:33.301072 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:33.301025 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-4jq5n" podStartSLOduration=2.097716831 podStartE2EDuration="3.301009175s" totalImagesPullingTime="1.203292344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:33.299216727 +0000 UTC m=+64.971620549" watchObservedRunningTime="2026-07-13 18:18:33.301009175 +0000 UTC m=+64.973412976" Jul 13 18:18:33.391158 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:33.391128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:34.582092 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.582050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:34.582515 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.582097 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:34.584672 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.584654 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 18:18:34.585202 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.585187 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 18:18:34.594850 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.594830 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f-original-pull-secret\") pod \"global-pull-secret-syncer-mjq45\" (UID: \"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f\") " pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:34.595001 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.594984 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4366c66f-0513-44fb-9d7e-3a4b72a84c2e-metrics-certs\") pod \"network-metrics-daemon-swrfq\" (UID: \"4366c66f-0513-44fb-9d7e-3a4b72a84c2e\") " pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:34.784656 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.784623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:34.787475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.787456 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 18:18:34.798223 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.798205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 18:18:34.808568 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.808538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb6pc\" (UniqueName: \"kubernetes.io/projected/6a21c63f-9efe-4bb3-bcb0-27bc13478027-kube-api-access-wb6pc\") pod \"network-check-target-zc2x8\" (UID: \"6a21c63f-9efe-4bb3-bcb0-27bc13478027\") " pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:34.811751 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.811733 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j9kl2\"" Jul 13 18:18:34.815717 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.815701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mjq45" Jul 13 18:18:34.819509 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.819497 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-swrfq" Jul 13 18:18:34.950657 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.950626 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mjq45"] Jul 13 18:18:34.953359 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:34.953321 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc9c4cfd_d45c_4e0d_86df_0cb6cb9c1d9f.slice/crio-3d32d2b979a99cb69d75f299d2ef477ebcbbeddf99e7089e3dd29603e42e5423 WatchSource:0}: Error finding container 3d32d2b979a99cb69d75f299d2ef477ebcbbeddf99e7089e3dd29603e42e5423: Status 404 returned error can't find the container with id 3d32d2b979a99cb69d75f299d2ef477ebcbbeddf99e7089e3dd29603e42e5423 Jul 13 18:18:34.966156 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:34.966126 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-swrfq"] Jul 13 18:18:34.969713 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:34.969687 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4366c66f_0513_44fb_9d7e_3a4b72a84c2e.slice/crio-1a6f14c7266b0241e06ae85928bd483628507571ce60248e6b7563929a541898 WatchSource:0}: Error finding container 1a6f14c7266b0241e06ae85928bd483628507571ce60248e6b7563929a541898: Status 404 returned error can't find the container with id 1a6f14c7266b0241e06ae85928bd483628507571ce60248e6b7563929a541898 Jul 13 18:18:35.104416 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.104334 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lqlm7\"" Jul 13 18:18:35.111652 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.111632 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:35.239080 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.239050 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zc2x8"] Jul 13 18:18:35.242146 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:35.242125 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a21c63f_9efe_4bb3_bcb0_27bc13478027.slice/crio-e058e10059ad25ef29b5333ef492562fc7b424c0794bcf2c9d1aedc3315dc91d WatchSource:0}: Error finding container e058e10059ad25ef29b5333ef492562fc7b424c0794bcf2c9d1aedc3315dc91d: Status 404 returned error can't find the container with id e058e10059ad25ef29b5333ef492562fc7b424c0794bcf2c9d1aedc3315dc91d Jul 13 18:18:35.289285 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.289253 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swrfq" event={"ID":"4366c66f-0513-44fb-9d7e-3a4b72a84c2e","Type":"ContainerStarted","Data":"1a6f14c7266b0241e06ae85928bd483628507571ce60248e6b7563929a541898"} Jul 13 18:18:35.290481 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.290456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zc2x8" event={"ID":"6a21c63f-9efe-4bb3-bcb0-27bc13478027","Type":"ContainerStarted","Data":"e058e10059ad25ef29b5333ef492562fc7b424c0794bcf2c9d1aedc3315dc91d"} Jul 13 18:18:35.291497 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.291477 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mjq45" event={"ID":"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f","Type":"ContainerStarted","Data":"3d32d2b979a99cb69d75f299d2ef477ebcbbeddf99e7089e3dd29603e42e5423"} Jul 13 18:18:35.326950 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.326901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:35.545846 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.545797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:35.652454 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.652408 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:35.702517 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.702482 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5b8xh"] Jul 13 18:18:35.705734 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.705709 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.710793 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.710742 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 13 18:18:35.710793 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.710772 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-529s2\"" Jul 13 18:18:35.710793 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.710786 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 13 18:18:35.711119 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.710772 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 13 18:18:35.723960 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.723878 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5b8xh"] Jul 13 18:18:35.733155 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.732489 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v42wl"] Jul 13 18:18:35.735347 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.735327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.738540 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.738286 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 18:18:35.738540 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.738439 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 18:18:35.739433 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.739167 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g4jzr\"" Jul 13 18:18:35.739433 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.739397 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 18:18:35.760927 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.760812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:35.791849 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.791820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.792015 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.791859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-sys\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792015 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.791888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.792015 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.791933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792146 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-wtmp\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792146 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db72ebb3-be1c-4513-bf71-dc281161b84e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.792146 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-metrics-client-ca\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-accelerators-collector-config\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjmpn\" (UniqueName: \"kubernetes.io/projected/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-api-access-gjmpn\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.792295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792259 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-tls\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db72ebb3-be1c-4513-bf71-dc281161b84e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.792480 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-root\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792480 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792323 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.792480 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-textfile\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.792480 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.792389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn9fh\" (UniqueName: \"kubernetes.io/projected/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-kube-api-access-rn9fh\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893317 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.893453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893357 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-wtmp\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db72ebb3-be1c-4513-bf71-dc281161b84e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.893453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893414 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-metrics-client-ca\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-accelerators-collector-config\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjmpn\" (UniqueName: \"kubernetes.io/projected/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-api-access-gjmpn\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-tls\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db72ebb3-be1c-4513-bf71-dc281161b84e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-root\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893565 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-wtmp\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893631 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-textfile\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn9fh\" (UniqueName: \"kubernetes.io/projected/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-kube-api-access-rn9fh\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.893720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.894114 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-sys\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.894114 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.893825 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-sys\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.894114 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.894091 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.894266 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.894196 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/db72ebb3-be1c-4513-bf71-dc281161b84e-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.894638 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.894616 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-metrics-client-ca\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.894781 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.894696 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-accelerators-collector-config\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.895233 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.895165 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-textfile\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.895233 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.895187 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-root\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.895384 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.895298 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db72ebb3-be1c-4513-bf71-dc281161b84e-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.896839 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.896797 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-tls\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.897352 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.897328 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:35.897737 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.897693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.897861 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.897843 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.902072 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.902053 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjmpn\" (UniqueName: \"kubernetes.io/projected/db72ebb3-be1c-4513-bf71-dc281161b84e-kube-api-access-gjmpn\") pod \"kube-state-metrics-785778ff74-5b8xh\" (UID: \"db72ebb3-be1c-4513-bf71-dc281161b84e\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:35.903144 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:35.903123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn9fh\" (UniqueName: \"kubernetes.io/projected/3a7dacb9-b578-4e00-b3c3-fdc2fd059250-kube-api-access-rn9fh\") pod \"node-exporter-v42wl\" (UID: \"3a7dacb9-b578-4e00-b3c3-fdc2fd059250\") " pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:36.018090 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.018064 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" Jul 13 18:18:36.047117 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.047088 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v42wl" Jul 13 18:18:36.063497 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:36.063457 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a7dacb9_b578_4e00_b3c3_fdc2fd059250.slice/crio-f421bbd8014e4183aecd254a7703ed00406adcc54d6e72ccfd89273e37172d56 WatchSource:0}: Error finding container f421bbd8014e4183aecd254a7703ed00406adcc54d6e72ccfd89273e37172d56: Status 404 returned error can't find the container with id f421bbd8014e4183aecd254a7703ed00406adcc54d6e72ccfd89273e37172d56 Jul 13 18:18:36.174162 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.174130 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-5b8xh"] Jul 13 18:18:36.178721 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:36.178686 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb72ebb3_be1c_4513_bf71_dc281161b84e.slice/crio-985fc0a4474c97ea1665b5c98e063d70b9b9f7af845aed5244097ebf9aa84c31 WatchSource:0}: Error finding container 985fc0a4474c97ea1665b5c98e063d70b9b9f7af845aed5244097ebf9aa84c31: Status 404 returned error can't find the container with id 985fc0a4474c97ea1665b5c98e063d70b9b9f7af845aed5244097ebf9aa84c31 Jul 13 18:18:36.294711 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.294643 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:36.297441 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.297370 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" event={"ID":"db72ebb3-be1c-4513-bf71-dc281161b84e","Type":"ContainerStarted","Data":"985fc0a4474c97ea1665b5c98e063d70b9b9f7af845aed5244097ebf9aa84c31"} Jul 13 18:18:36.299537 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.299511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swrfq" event={"ID":"4366c66f-0513-44fb-9d7e-3a4b72a84c2e","Type":"ContainerStarted","Data":"421354dbf154809d3afbac84b5a0b54eab5810197b940ce44a6938fd8d9d8c58"} Jul 13 18:18:36.299670 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.299558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-swrfq" event={"ID":"4366c66f-0513-44fb-9d7e-3a4b72a84c2e","Type":"ContainerStarted","Data":"17c8c82f24900897ad2dac6841ee40344a628598a4e965c9481fdc3c2e5d4b16"} Jul 13 18:18:36.300958 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.300906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v42wl" event={"ID":"3a7dacb9-b578-4e00-b3c3-fdc2fd059250","Type":"ContainerStarted","Data":"f421bbd8014e4183aecd254a7703ed00406adcc54d6e72ccfd89273e37172d56"} Jul 13 18:18:36.316782 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.316729 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-swrfq" podStartSLOduration=66.467753688 podStartE2EDuration="1m7.316711504s" totalImagesPullingTime="848.957816ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:36.31552123 +0000 UTC m=+67.987925052" watchObservedRunningTime="2026-07-13 18:18:36.316711504 +0000 UTC m=+67.989115329" Jul 13 18:18:36.395851 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.395770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:36.505072 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.505033 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:36.600736 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:36.598610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:37.064451 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.064380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:37.181988 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.181959 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:37.308973 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.307597 2565 generic.go:356] "Generic (PLEG): container finished" podID="3a7dacb9-b578-4e00-b3c3-fdc2fd059250" containerID="23338e6b62da08737e28901fc49e6d1de1aee693ed3299ea10e70b08c8289d7e" exitCode=0 Jul 13 18:18:37.308973 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.308728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v42wl" event={"ID":"3a7dacb9-b578-4e00-b3c3-fdc2fd059250","Type":"ContainerDied","Data":"23338e6b62da08737e28901fc49e6d1de1aee693ed3299ea10e70b08c8289d7e"} Jul 13 18:18:37.621063 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.620911 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54967b65dd-qmqdh"] Jul 13 18:18:37.625154 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.625126 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.632095 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.632071 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 13 18:18:37.632376 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.632357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 13 18:18:37.632779 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.632760 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 13 18:18:37.632908 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.632883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 13 18:18:37.633685 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.633666 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 13 18:18:37.633901 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.633883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-88qi3lprgqe89\"" Jul 13 18:18:37.634295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.634088 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8w4m4\"" Jul 13 18:18:37.648174 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.648135 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54967b65dd-qmqdh"] Jul 13 18:18:37.708876 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-tls\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.708876 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-grpc-tls\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.708876 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-metrics-client-ca\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.708876 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5b7g\" (UniqueName: \"kubernetes.io/projected/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-kube-api-access-s5b7g\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.708876 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.708876 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.708876 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.709381 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.708929 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.809980 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.809952 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-grpc-tls\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.810116 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.809999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-metrics-client-ca\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.810116 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.810031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5b7g\" (UniqueName: \"kubernetes.io/projected/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-kube-api-access-s5b7g\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.810116 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.810064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.810116 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.810094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.810329 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.810120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.810329 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.810173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.810329 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.810230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-tls\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.811286 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.811259 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-metrics-client-ca\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.813544 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.813509 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.813666 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.813627 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.814146 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.814102 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-grpc-tls\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.816297 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.816269 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.817649 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.817628 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-tls\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.818069 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.818049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.822890 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.822868 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5b7g\" (UniqueName: \"kubernetes.io/projected/4b7b14f3-829f-4d57-b0a2-31c27b8453cd-kube-api-access-s5b7g\") pod \"thanos-querier-54967b65dd-qmqdh\" (UID: \"4b7b14f3-829f-4d57-b0a2-31c27b8453cd\") " pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:37.938318 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:37.938234 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:38.162392 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.162356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:38.258628 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.258531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:38.261473 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.261448 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w8bx9" Jul 13 18:18:38.314266 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.314234 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v42wl" event={"ID":"3a7dacb9-b578-4e00-b3c3-fdc2fd059250","Type":"ContainerStarted","Data":"2d46634f3f2b9687ed4e1a4a2540774c90928d8f52cf8e0cdade2b6dcd4cebd0"} Jul 13 18:18:38.356769 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.356728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:38.630718 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.630690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:38.731347 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.731306 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:38.866010 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:38.865981 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:39.047916 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:39.047877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:39.417055 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:39.416953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:39.511888 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:39.511854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:39.612239 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:39.612201 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:40.141142 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.141106 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:40.242189 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.242159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:40.328382 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.328316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v42wl" event={"ID":"3a7dacb9-b578-4e00-b3c3-fdc2fd059250","Type":"ContainerStarted","Data":"d84770d5b098be5a2a40069ceca3deb11f5f7dc6b4e209f06012d1dbc7e63183"} Jul 13 18:18:40.347519 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.347140 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:40.362076 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.362018 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v42wl" podStartSLOduration=4.257567402 podStartE2EDuration="5.361991772s" totalImagesPullingTime="1.020402667s" totalInitContainerRuntime="84.021703ms" isStatefulPod=true podCreationTimestamp="2026-07-13 18:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:40.360883744 +0000 UTC m=+72.033287568" watchObservedRunningTime="2026-07-13 18:18:40.361991772 +0000 UTC m=+72.034395596" Jul 13 18:18:40.377091 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.377060 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp"] Jul 13 18:18:40.380081 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.379616 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:40.385230 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.384973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 13 18:18:40.389782 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.389759 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2v5qk\"" Jul 13 18:18:40.392276 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.392204 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp"] Jul 13 18:18:40.402718 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.402680 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54967b65dd-qmqdh"] Jul 13 18:18:40.436063 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.434872 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnsvt\" (UniqueName: \"kubernetes.io/projected/249f6c38-23c4-4349-91ad-374c4659b774-kube-api-access-rnsvt\") pod \"monitoring-plugin-5f68df7f58-99bjp\" (UID: \"249f6c38-23c4-4349-91ad-374c4659b774\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:40.436063 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.434918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/249f6c38-23c4-4349-91ad-374c4659b774-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-99bjp\" (UID: \"249f6c38-23c4-4349-91ad-374c4659b774\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:40.452283 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.452254 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:40.535768 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.535736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnsvt\" (UniqueName: \"kubernetes.io/projected/249f6c38-23c4-4349-91ad-374c4659b774-kube-api-access-rnsvt\") pod \"monitoring-plugin-5f68df7f58-99bjp\" (UID: \"249f6c38-23c4-4349-91ad-374c4659b774\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:40.535954 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.535779 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/249f6c38-23c4-4349-91ad-374c4659b774-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-99bjp\" (UID: \"249f6c38-23c4-4349-91ad-374c4659b774\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:40.535954 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:40.535901 2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 13 18:18:40.536088 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:18:40.535967 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/249f6c38-23c4-4349-91ad-374c4659b774-monitoring-plugin-cert podName:249f6c38-23c4-4349-91ad-374c4659b774 nodeName:}" failed. No retries permitted until 2026-07-13 18:18:41.035946818 +0000 UTC m=+72.708350633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/249f6c38-23c4-4349-91ad-374c4659b774-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-99bjp" (UID: "249f6c38-23c4-4349-91ad-374c4659b774") : secret "monitoring-plugin-cert" not found Jul 13 18:18:40.547399 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.547345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnsvt\" (UniqueName: \"kubernetes.io/projected/249f6c38-23c4-4349-91ad-374c4659b774-kube-api-access-rnsvt\") pod \"monitoring-plugin-5f68df7f58-99bjp\" (UID: \"249f6c38-23c4-4349-91ad-374c4659b774\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:40.807462 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:40.807430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:41.039535 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.039505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/249f6c38-23c4-4349-91ad-374c4659b774-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-99bjp\" (UID: \"249f6c38-23c4-4349-91ad-374c4659b774\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:41.042155 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.042136 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/249f6c38-23c4-4349-91ad-374c4659b774-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-99bjp\" (UID: \"249f6c38-23c4-4349-91ad-374c4659b774\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:41.292396 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.292367 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:41.338508 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.338412 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mjq45" event={"ID":"fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f","Type":"ContainerStarted","Data":"701876dbd9bb068b110509a4d74c3fa76be3dea6f60cad7e4f77eb488102ea4a"} Jul 13 18:18:41.340034 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.339954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" event={"ID":"4b7b14f3-829f-4d57-b0a2-31c27b8453cd","Type":"ContainerStarted","Data":"5d2408681fb3259079d0e819cc5d4336cd0e4cd77712112ebeadea56c0cfbbfa"} Jul 13 18:18:41.341745 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.341718 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zc2x8" event={"ID":"6a21c63f-9efe-4bb3-bcb0-27bc13478027","Type":"ContainerStarted","Data":"10e10d077e99b554b1fc2aaf1ac4dafeec798102be54fd30f50b752d0f3ddca1"} Jul 13 18:18:41.341862 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.341787 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:18:41.344995 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.344936 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" event={"ID":"db72ebb3-be1c-4513-bf71-dc281161b84e","Type":"ContainerStarted","Data":"57730a083e1fa0240f44c5c8919030b8dba476e52429d7f40877d59db861feaf"} Jul 13 18:18:41.344995 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.344983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" event={"ID":"db72ebb3-be1c-4513-bf71-dc281161b84e","Type":"ContainerStarted","Data":"2c8e62edcdccc87649a27c9e8a829ba56b327bcc5edb76136d74218b50ff3719"} Jul 13 18:18:41.345179 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.345013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" event={"ID":"db72ebb3-be1c-4513-bf71-dc281161b84e","Type":"ContainerStarted","Data":"15e1c627eecb36519aed28653ba3ea0ad32166635fed12a1e671dab902fd67f7"} Jul 13 18:18:41.361164 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.361102 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mjq45" podStartSLOduration=67.077870845 podStartE2EDuration="1m12.361083482s" totalImagesPullingTime="5.283212637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:41.358768629 +0000 UTC m=+73.031172454" watchObservedRunningTime="2026-07-13 18:18:41.361083482 +0000 UTC m=+73.033487288" Jul 13 18:18:41.382851 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.382792 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zc2x8" podStartSLOduration=67.397611804 podStartE2EDuration="1m12.382771385s" totalImagesPullingTime="4.985159581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:41.380872213 +0000 UTC m=+73.053276037" watchObservedRunningTime="2026-07-13 18:18:41.382771385 +0000 UTC m=+73.055175210" Jul 13 18:18:41.424882 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.424831 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-5b8xh" podStartSLOduration=2.389039423 podStartE2EDuration="6.424806714s" totalImagesPullingTime="4.035767291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:41.424388601 +0000 UTC m=+73.096792426" watchObservedRunningTime="2026-07-13 18:18:41.424806714 +0000 UTC m=+73.097210538" Jul 13 18:18:41.467847 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.465563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp"] Jul 13 18:18:41.470141 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:41.470111 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249f6c38_23c4_4349_91ad_374c4659b774.slice/crio-dfd1b84f2dc8d161595be373e2be201e2aa997f7065e7cb6583ee96b1b8002f6 WatchSource:0}: Error finding container dfd1b84f2dc8d161595be373e2be201e2aa997f7065e7cb6583ee96b1b8002f6: Status 404 returned error can't find the container with id dfd1b84f2dc8d161595be373e2be201e2aa997f7065e7cb6583ee96b1b8002f6 Jul 13 18:18:41.695757 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.695598 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7584cd9ff4-wcbkd"] Jul 13 18:18:41.700208 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.698715 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.713940 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.713882 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7584cd9ff4-wcbkd"] Jul 13 18:18:41.844939 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.844901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-service-ca\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.844939 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.844934 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5m79\" (UniqueName: \"kubernetes.io/projected/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-kube-api-access-m5m79\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.845191 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.844962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-oauth-serving-cert\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.845191 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.845051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-config\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.845191 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.845146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-oauth-config\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.845352 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.845197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-trusted-ca-bundle\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.845352 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.845267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-serving-cert\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.946611 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.946501 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-config\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.946611 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.946566 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-oauth-config\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.946829 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.946614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-trusted-ca-bundle\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.946829 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.946644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-serving-cert\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.946829 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.946682 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-service-ca\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.946829 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.946705 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5m79\" (UniqueName: \"kubernetes.io/projected/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-kube-api-access-m5m79\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.946829 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.946736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-oauth-serving-cert\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.947451 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.947385 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-oauth-serving-cert\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.947451 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.947396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-config\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.947673 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.947478 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-trusted-ca-bundle\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.947996 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.947975 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-service-ca\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.950213 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.950174 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-oauth-config\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.950359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.950318 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-serving-cert\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.957042 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.956216 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 18:18:41.961426 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.961039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:41.963532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.963387 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 13 18:18:41.963897 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.963874 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 13 18:18:41.964240 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.964218 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5m79\" (UniqueName: \"kubernetes.io/projected/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-kube-api-access-m5m79\") pod \"console-7584cd9ff4-wcbkd\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:41.964342 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.964282 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 13 18:18:41.964787 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.964514 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 13 18:18:41.964787 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.964533 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 13 18:18:41.964787 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.964632 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 13 18:18:41.964787 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.964745 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 13 18:18:41.965148 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965014 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 13 18:18:41.965148 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965030 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 13 18:18:41.965148 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965078 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4tf49s6mpf9pt\"" Jul 13 18:18:41.965565 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965523 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 13 18:18:41.965565 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965548 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 13 18:18:41.965802 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965608 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lzqj9\"" Jul 13 18:18:41.965802 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965610 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 13 18:18:41.965802 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.965771 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 13 18:18:41.966187 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.966169 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 13 18:18:41.970373 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.970200 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 13 18:18:41.978639 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.978620 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 18:18:41.988453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:41.988420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:42.010479 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.010444 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:42.048180 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-config\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048210 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d86ae42-5178-4d98-8ebb-985c8904eca6-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v7bk\" (UniqueName: \"kubernetes.io/projected/1d86ae42-5178-4d98-8ebb-985c8904eca6-kube-api-access-6v7bk\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048498 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048514 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048531 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048830 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048571 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d86ae42-5178-4d98-8ebb-985c8904eca6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048830 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048614 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048830 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048830 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048830 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048830 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.048830 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.049090 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.048893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.078904 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.078872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:42.150314 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150514 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150514 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-config\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150514 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150433 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150514 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150523 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d86ae42-5178-4d98-8ebb-985c8904eca6-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150665 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v7bk\" (UniqueName: \"kubernetes.io/projected/1d86ae42-5178-4d98-8ebb-985c8904eca6-kube-api-access-6v7bk\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150738 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150764 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.150788 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d86ae42-5178-4d98-8ebb-985c8904eca6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151169 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150818 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151169 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151169 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151169 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151169 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151169 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.150984 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151169 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.151160 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151513 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.151194 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151513 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.151418 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.151698 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.151677 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.153639 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.151964 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.153639 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.152775 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.153639 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.153086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.153946 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.153900 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-config\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.154962 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.154854 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.154962 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.154902 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.155152 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.155124 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1d86ae42-5178-4d98-8ebb-985c8904eca6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.157947 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.157890 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.158511 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.158457 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.159102 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.159053 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.160692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.160369 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-web-config\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.160692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.160558 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1d86ae42-5178-4d98-8ebb-985c8904eca6-config-out\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.161333 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.161315 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.161508 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.161488 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1d86ae42-5178-4d98-8ebb-985c8904eca6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.161639 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.161622 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1d86ae42-5178-4d98-8ebb-985c8904eca6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.162699 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.162672 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v7bk\" (UniqueName: \"kubernetes.io/projected/1d86ae42-5178-4d98-8ebb-985c8904eca6-kube-api-access-6v7bk\") pod \"prometheus-k8s-0\" (UID: \"1d86ae42-5178-4d98-8ebb-985c8904eca6\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.276793 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.276466 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:42.349929 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.349820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" event={"ID":"249f6c38-23c4-4349-91ad-374c4659b774","Type":"ContainerStarted","Data":"dfd1b84f2dc8d161595be373e2be201e2aa997f7065e7cb6583ee96b1b8002f6"} Jul 13 18:18:42.472158 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.472131 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7584cd9ff4-wcbkd"] Jul 13 18:18:42.521984 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:42.521840 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 13 18:18:43.356768 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:43.356730 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerStarted","Data":"155d9e07ceaf27a1b1bf0f77d1ac3783e91c0cf0550a14ee0af5f78d9a54c6c8"} Jul 13 18:18:43.358849 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:43.358824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" event={"ID":"4b7b14f3-829f-4d57-b0a2-31c27b8453cd","Type":"ContainerStarted","Data":"28bb0c92f690fcb5db5c8a10fa509e49c2c0dc606f4fca5b44816abe1a53dfe1"} Jul 13 18:18:43.358970 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:43.358894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" event={"ID":"4b7b14f3-829f-4d57-b0a2-31c27b8453cd","Type":"ContainerStarted","Data":"106f354049839fed156c629d532aed8fac1892942ad471ca4296354ff832f497"} Jul 13 18:18:43.358970 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:43.358944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" event={"ID":"4b7b14f3-829f-4d57-b0a2-31c27b8453cd","Type":"ContainerStarted","Data":"3fd0c3c1b7297f7808877125d43e454a0b43cacf2e4b75554a492467bd19bf73"} Jul 13 18:18:43.360237 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:43.360211 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7584cd9ff4-wcbkd" event={"ID":"31f0ad51-6bc5-4c6d-9c2f-ad473574b510","Type":"ContainerStarted","Data":"907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71"} Jul 13 18:18:43.360307 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:43.360258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7584cd9ff4-wcbkd" event={"ID":"31f0ad51-6bc5-4c6d-9c2f-ad473574b510","Type":"ContainerStarted","Data":"609d8e335ed8e52131e6ef6ff32e9b1ba816fae321f2777ed7ede88cb505925a"} Jul 13 18:18:43.378691 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:43.378480 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7584cd9ff4-wcbkd" podStartSLOduration=2.378462519 podStartE2EDuration="2.378462519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:43.378032367 +0000 UTC m=+75.050436214" watchObservedRunningTime="2026-07-13 18:18:43.378462519 +0000 UTC m=+75.050866346" Jul 13 18:18:44.366855 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.366820 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" event={"ID":"4b7b14f3-829f-4d57-b0a2-31c27b8453cd","Type":"ContainerStarted","Data":"bf41629474189c1cf33b15182b4aad582b5879022b08c961dfeadb43378b534f"} Jul 13 18:18:44.367349 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.366900 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" event={"ID":"4b7b14f3-829f-4d57-b0a2-31c27b8453cd","Type":"ContainerStarted","Data":"8e7e7de72c397f6f07c34eee53ba2ef4185c0dc90791edb422135b484bfd8e6a"} Jul 13 18:18:44.367349 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.366939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" event={"ID":"4b7b14f3-829f-4d57-b0a2-31c27b8453cd","Type":"ContainerStarted","Data":"66e900a172063c9d8ed1ac573329ca93553ef2190c6661ae01fe2a681f3be8cd"} Jul 13 18:18:44.367349 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.366993 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:44.368323 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.368302 2565 generic.go:356] "Generic (PLEG): container finished" podID="1d86ae42-5178-4d98-8ebb-985c8904eca6" containerID="f3d5b24eec8a08af5075495fce6ca3b28bf82cc90205935fd5d1377f974f7480" exitCode=0 Jul 13 18:18:44.368443 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.368382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerDied","Data":"f3d5b24eec8a08af5075495fce6ca3b28bf82cc90205935fd5d1377f974f7480"} Jul 13 18:18:44.369926 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.369910 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" event={"ID":"249f6c38-23c4-4349-91ad-374c4659b774","Type":"ContainerStarted","Data":"8c8ecdd08f6db06d70f6730714c892246e3351d6efdfa56bfb6e1b80699ad0ad"} Jul 13 18:18:44.370236 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.370222 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:44.375632 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.375616 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" Jul 13 18:18:44.391955 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.391915 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" podStartSLOduration=4.108455983 podStartE2EDuration="7.391898325s" totalImagesPullingTime="3.283442342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:44.390332084 +0000 UTC m=+76.062735934" watchObservedRunningTime="2026-07-13 18:18:44.391898325 +0000 UTC m=+76.064302148" Jul 13 18:18:44.407998 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.407951 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-99bjp" podStartSLOduration=2.513675478 podStartE2EDuration="4.40793147s" totalImagesPullingTime="1.894255992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:44.406930174 +0000 UTC m=+76.079334007" watchObservedRunningTime="2026-07-13 18:18:44.40793147 +0000 UTC m=+76.080335293" Jul 13 18:18:44.882518 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.882487 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7584cd9ff4-wcbkd"] Jul 13 18:18:44.924052 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.924020 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b68994f5c-vbjs9"] Jul 13 18:18:44.928328 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.928309 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:44.944154 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:44.944121 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b68994f5c-vbjs9"] Jul 13 18:18:45.079787 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.079745 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-service-ca\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.079950 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.079837 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-trusted-ca-bundle\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.079950 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.079883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5pl\" (UniqueName: \"kubernetes.io/projected/24a05251-c491-4791-b7a2-75a333a4ede3-kube-api-access-6r5pl\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.079950 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.079906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-console-config\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.080046 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.080002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-oauth-config\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.080081 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.080065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-serving-cert\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.080114 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.080089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-oauth-serving-cert\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.180896 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.180794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-trusted-ca-bundle\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.180896 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.180853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5pl\" (UniqueName: \"kubernetes.io/projected/24a05251-c491-4791-b7a2-75a333a4ede3-kube-api-access-6r5pl\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.180896 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.180878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-console-config\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.181164 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.180921 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-oauth-config\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.181164 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.180972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-serving-cert\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.181164 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.180994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-oauth-serving-cert\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.181164 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.181040 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-service-ca\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.181946 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.181912 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-console-config\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.182127 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.182107 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-service-ca\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.182218 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.182193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-oauth-serving-cert\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.182433 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.182411 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-trusted-ca-bundle\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.183842 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.183810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-serving-cert\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.183996 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.183979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-oauth-config\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.191654 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.191631 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5pl\" (UniqueName: \"kubernetes.io/projected/24a05251-c491-4791-b7a2-75a333a4ede3-kube-api-access-6r5pl\") pod \"console-b68994f5c-vbjs9\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.239154 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.239117 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:45.394084 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:45.392804 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b68994f5c-vbjs9"] Jul 13 18:18:45.395436 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:18:45.395414 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a05251_c491_4791_b7a2_75a333a4ede3.slice/crio-7c6d530202cb7308cd9763628ba6b4d201babdb0a7155daeeb1e822eec1fd215 WatchSource:0}: Error finding container 7c6d530202cb7308cd9763628ba6b4d201babdb0a7155daeeb1e822eec1fd215: Status 404 returned error can't find the container with id 7c6d530202cb7308cd9763628ba6b4d201babdb0a7155daeeb1e822eec1fd215 Jul 13 18:18:46.192459 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:46.192427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:46.382042 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:46.382002 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68994f5c-vbjs9" event={"ID":"24a05251-c491-4791-b7a2-75a333a4ede3","Type":"ContainerStarted","Data":"65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e"} Jul 13 18:18:46.382228 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:46.382062 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68994f5c-vbjs9" event={"ID":"24a05251-c491-4791-b7a2-75a333a4ede3","Type":"ContainerStarted","Data":"7c6d530202cb7308cd9763628ba6b4d201babdb0a7155daeeb1e822eec1fd215"} Jul 13 18:18:46.417503 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:46.417454 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b68994f5c-vbjs9" podStartSLOduration=2.417438576 podStartE2EDuration="2.417438576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:46.415781091 +0000 UTC m=+78.088184914" watchObservedRunningTime="2026-07-13 18:18:46.417438576 +0000 UTC m=+78.089842465" Jul 13 18:18:47.002428 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:47.002394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:49.079680 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.079649 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:49.180287 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.180256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:49.397960 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.397811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerStarted","Data":"95d80f21991db992fb5d23bc0308d2b347dd15aad6a7b288be48a7a2e5c09af6"} Jul 13 18:18:49.397960 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.397877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerStarted","Data":"55d8b6f04ac3871b56c983f4d55a447df99476cbf64b13e9eee4bb46c356e64d"} Jul 13 18:18:49.397960 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.397902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerStarted","Data":"dc432eccc0f654fe46852982bcba64a36abab07e918af175a7786a0d37764b58"} Jul 13 18:18:49.397960 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.397929 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerStarted","Data":"7389f861a073a39dd71c52e28ab716bc81939174c0e36c858ce3eb3e9eb9c1ee"} Jul 13 18:18:49.397960 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.397952 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerStarted","Data":"774789f528d561f21fe2bf0da86ef09ee785c17bd8960b7bbc7bd13ddaea2d7d"} Jul 13 18:18:49.398226 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:49.397985 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1d86ae42-5178-4d98-8ebb-985c8904eca6","Type":"ContainerStarted","Data":"825db865e473d332c78dba7566ba3ff7a35f73a43d6435387ac25c9d8689378d"} Jul 13 18:18:50.381076 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:50.381050 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54967b65dd-qmqdh" Jul 13 18:18:50.409426 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:50.409371 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.839053694 podStartE2EDuration="9.409349818s" totalImagesPullingTime="5.547391691s" totalInitContainerRuntime="22.904433ms" isStatefulPod=false podCreationTimestamp="2026-07-13 18:18:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:18:49.439401829 +0000 UTC m=+81.111805689" watchObservedRunningTime="2026-07-13 18:18:50.409349818 +0000 UTC m=+82.081753643" Jul 13 18:18:52.011305 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:52.011249 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:18:52.277097 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:52.277013 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:18:54.392933 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:54.392901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:54.456458 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:54.456424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:55.239740 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.239706 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:55.239898 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.239768 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:55.244523 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.244500 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:55.424257 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.424230 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:18:55.471463 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.471427 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64895f784c-bv6ss"] Jul 13 18:18:55.601241 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.601211 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:55.698536 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.698509 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:55.797764 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:55.797739 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:18:59.133731 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:18:59.133698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:19:05.648344 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:05.648313 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:19:05.718537 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:05.718507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:19:10.401065 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:10.401019 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7584cd9ff4-wcbkd" podUID="31f0ad51-6bc5-4c6d-9c2f-ad473574b510" containerName="console" containerID="cri-o://907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71" gracePeriod=15 Jul 13 18:19:11.175444 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.175415 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:19:11.219790 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.219756 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-serving-cert\") pod \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " Jul 13 18:19:11.219790 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.219788 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-oauth-config\") pod \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " Jul 13 18:19:11.220023 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.219821 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-trusted-ca-bundle\") pod \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " Jul 13 18:19:11.220023 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.219843 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5m79\" (UniqueName: \"kubernetes.io/projected/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-kube-api-access-m5m79\") pod \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " Jul 13 18:19:11.220023 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.219871 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-oauth-serving-cert\") pod \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " Jul 13 18:19:11.220023 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.219887 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-config\") pod \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " Jul 13 18:19:11.220023 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.219909 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-service-ca\") pod \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\" (UID: \"31f0ad51-6bc5-4c6d-9c2f-ad473574b510\") " Jul 13 18:19:11.220400 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.220361 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31f0ad51-6bc5-4c6d-9c2f-ad473574b510" (UID: "31f0ad51-6bc5-4c6d-9c2f-ad473574b510"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:11.220400 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.220386 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "31f0ad51-6bc5-4c6d-9c2f-ad473574b510" (UID: "31f0ad51-6bc5-4c6d-9c2f-ad473574b510"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:11.220562 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.220436 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-config" (OuterVolumeSpecName: "console-config") pod "31f0ad51-6bc5-4c6d-9c2f-ad473574b510" (UID: "31f0ad51-6bc5-4c6d-9c2f-ad473574b510"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:11.220562 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.220452 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-service-ca" (OuterVolumeSpecName: "service-ca") pod "31f0ad51-6bc5-4c6d-9c2f-ad473574b510" (UID: "31f0ad51-6bc5-4c6d-9c2f-ad473574b510"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:11.222122 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.222098 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31f0ad51-6bc5-4c6d-9c2f-ad473574b510" (UID: "31f0ad51-6bc5-4c6d-9c2f-ad473574b510"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:19:11.222364 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.222345 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-kube-api-access-m5m79" (OuterVolumeSpecName: "kube-api-access-m5m79") pod "31f0ad51-6bc5-4c6d-9c2f-ad473574b510" (UID: "31f0ad51-6bc5-4c6d-9c2f-ad473574b510"). InnerVolumeSpecName "kube-api-access-m5m79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:19:11.222431 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.222349 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31f0ad51-6bc5-4c6d-9c2f-ad473574b510" (UID: "31f0ad51-6bc5-4c6d-9c2f-ad473574b510"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:19:11.320714 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.320682 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-service-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.320714 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.320714 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.320922 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.320726 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-oauth-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.320922 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.320738 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.320922 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.320748 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5m79\" (UniqueName: \"kubernetes.io/projected/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-kube-api-access-m5m79\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.320922 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.320757 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-oauth-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.320922 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.320768 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31f0ad51-6bc5-4c6d-9c2f-ad473574b510-console-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:11.496871 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.496838 2565 generic.go:356] "Generic (PLEG): container finished" podID="31f0ad51-6bc5-4c6d-9c2f-ad473574b510" containerID="907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71" exitCode=0 Jul 13 18:19:11.497283 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.496885 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7584cd9ff4-wcbkd" Jul 13 18:19:11.497283 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.496886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7584cd9ff4-wcbkd" event={"ID":"31f0ad51-6bc5-4c6d-9c2f-ad473574b510","Type":"ContainerDied","Data":"907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71"} Jul 13 18:19:11.497283 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.496943 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7584cd9ff4-wcbkd" event={"ID":"31f0ad51-6bc5-4c6d-9c2f-ad473574b510","Type":"ContainerDied","Data":"609d8e335ed8e52131e6ef6ff32e9b1ba816fae321f2777ed7ede88cb505925a"} Jul 13 18:19:11.497283 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.496966 2565 scope.go:117] "RemoveContainer" containerID="907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71" Jul 13 18:19:11.505966 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.505951 2565 scope.go:117] "RemoveContainer" containerID="907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71" Jul 13 18:19:11.506268 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:19:11.506242 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71\": container with ID starting with 907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71 not found: ID does not exist" containerID="907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71" Jul 13 18:19:11.506339 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.506279 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71"} err="failed to get container status \"907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71\": rpc error: code = NotFound desc = could not find container \"907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71\": container with ID starting with 907795f61be82f94c78b2195db32e54fd863f74176111a4571b0383fb9facb71 not found: ID does not exist" Jul 13 18:19:11.517708 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.517686 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7584cd9ff4-wcbkd"] Jul 13 18:19:11.521673 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:11.521651 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7584cd9ff4-wcbkd"] Jul 13 18:19:12.353661 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:12.353623 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zc2x8" Jul 13 18:19:12.991851 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:12.991816 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31f0ad51-6bc5-4c6d-9c2f-ad473574b510" path="/var/lib/kubelet/pods/31f0ad51-6bc5-4c6d-9c2f-ad473574b510/volumes" Jul 13 18:19:20.492295 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.492250 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64895f784c-bv6ss" podUID="a8102fcc-0ccb-4ba5-8c17-00920e98f39a" containerName="console" containerID="cri-o://f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1" gracePeriod=15 Jul 13 18:19:20.740329 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.740300 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:19:20.804850 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.804825 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-oauth-config\") pod \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " Jul 13 18:19:20.805009 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.804856 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-serving-cert\") pod \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " Jul 13 18:19:20.805009 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.804883 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-trusted-ca-bundle\") pod \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " Jul 13 18:19:20.805009 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.804903 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-oauth-serving-cert\") pod \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " Jul 13 18:19:20.805180 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.805017 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz85b\" (UniqueName: \"kubernetes.io/projected/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-kube-api-access-bz85b\") pod \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " Jul 13 18:19:20.805180 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.805049 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-service-ca\") pod \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " Jul 13 18:19:20.805180 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.805106 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-config\") pod \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\" (UID: \"a8102fcc-0ccb-4ba5-8c17-00920e98f39a\") " Jul 13 18:19:20.805366 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.805271 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8102fcc-0ccb-4ba5-8c17-00920e98f39a" (UID: "a8102fcc-0ccb-4ba5-8c17-00920e98f39a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:20.805449 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.805372 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8102fcc-0ccb-4ba5-8c17-00920e98f39a" (UID: "a8102fcc-0ccb-4ba5-8c17-00920e98f39a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:20.805497 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.805441 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8102fcc-0ccb-4ba5-8c17-00920e98f39a" (UID: "a8102fcc-0ccb-4ba5-8c17-00920e98f39a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:20.805624 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.805607 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-config" (OuterVolumeSpecName: "console-config") pod "a8102fcc-0ccb-4ba5-8c17-00920e98f39a" (UID: "a8102fcc-0ccb-4ba5-8c17-00920e98f39a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:19:20.807209 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.807187 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-kube-api-access-bz85b" (OuterVolumeSpecName: "kube-api-access-bz85b") pod "a8102fcc-0ccb-4ba5-8c17-00920e98f39a" (UID: "a8102fcc-0ccb-4ba5-8c17-00920e98f39a"). InnerVolumeSpecName "kube-api-access-bz85b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:19:20.807517 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.807490 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8102fcc-0ccb-4ba5-8c17-00920e98f39a" (UID: "a8102fcc-0ccb-4ba5-8c17-00920e98f39a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:19:20.807653 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.807539 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8102fcc-0ccb-4ba5-8c17-00920e98f39a" (UID: "a8102fcc-0ccb-4ba5-8c17-00920e98f39a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:19:20.906173 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.906145 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-oauth-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:20.906173 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.906168 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:20.906173 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.906177 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:20.906345 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.906188 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-oauth-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:20.906345 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.906196 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz85b\" (UniqueName: \"kubernetes.io/projected/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-kube-api-access-bz85b\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:20.906345 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.906205 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-service-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:20.906345 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:20.906212 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8102fcc-0ccb-4ba5-8c17-00920e98f39a-console-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:19:21.538617 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.538569 2565 generic.go:356] "Generic (PLEG): container finished" podID="a8102fcc-0ccb-4ba5-8c17-00920e98f39a" containerID="f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1" exitCode=0 Jul 13 18:19:21.539021 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.538634 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64895f784c-bv6ss" Jul 13 18:19:21.539021 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.538655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64895f784c-bv6ss" event={"ID":"a8102fcc-0ccb-4ba5-8c17-00920e98f39a","Type":"ContainerDied","Data":"f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1"} Jul 13 18:19:21.539021 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.538707 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64895f784c-bv6ss" event={"ID":"a8102fcc-0ccb-4ba5-8c17-00920e98f39a","Type":"ContainerDied","Data":"9ef28c545ccb428c78bd8527251db6075cffe28e678f0ddbb278d3f458221dfa"} Jul 13 18:19:21.539021 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.538728 2565 scope.go:117] "RemoveContainer" containerID="f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1" Jul 13 18:19:21.546697 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.546680 2565 scope.go:117] "RemoveContainer" containerID="f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1" Jul 13 18:19:21.546935 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:19:21.546917 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1\": container with ID starting with f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1 not found: ID does not exist" containerID="f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1" Jul 13 18:19:21.547030 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.546943 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1"} err="failed to get container status \"f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1\": rpc error: code = NotFound desc = could not find container \"f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1\": container with ID starting with f775f4f8fbd6fd93aa68ac8104b0d7f2f349bddac6fed30c6f72b1bafa1551d1 not found: ID does not exist" Jul 13 18:19:21.556548 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.556525 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64895f784c-bv6ss"] Jul 13 18:19:21.562334 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:21.562314 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64895f784c-bv6ss"] Jul 13 18:19:22.995798 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:22.995759 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8102fcc-0ccb-4ba5-8c17-00920e98f39a" path="/var/lib/kubelet/pods/a8102fcc-0ccb-4ba5-8c17-00920e98f39a/volumes" Jul 13 18:19:42.277449 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:42.277406 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:19:42.298628 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:42.298577 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:19:42.635036 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:42.635003 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 13 18:19:51.813548 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:51.813513 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:19:51.877359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:19:51.877317 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:03.952359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:03.952322 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:04.052180 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:04.052140 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:07.735397 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:07.735365 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:07.848711 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:07.848677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:09.417841 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:09.417810 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:09.561834 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:09.561804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:18.436641 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:18.436600 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b68994f5c-vbjs9"] Jul 13 18:20:18.540980 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:18.540950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:18.652201 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:18.652170 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:18.719800 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:18.719700 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:26.730138 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:26.730105 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:26.829999 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:26.829967 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:38.333165 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:38.333133 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:38.458310 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:38.458276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:20:43.456469 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.456426 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b68994f5c-vbjs9" podUID="24a05251-c491-4791-b7a2-75a333a4ede3" containerName="console" containerID="cri-o://65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e" gracePeriod=15 Jul 13 18:20:43.692383 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.692362 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:20:43.774557 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774475 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-trusted-ca-bundle\") pod \"24a05251-c491-4791-b7a2-75a333a4ede3\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " Jul 13 18:20:43.774557 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774523 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r5pl\" (UniqueName: \"kubernetes.io/projected/24a05251-c491-4791-b7a2-75a333a4ede3-kube-api-access-6r5pl\") pod \"24a05251-c491-4791-b7a2-75a333a4ede3\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " Jul 13 18:20:43.774797 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774604 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-serving-cert\") pod \"24a05251-c491-4791-b7a2-75a333a4ede3\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " Jul 13 18:20:43.774797 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774633 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-oauth-config\") pod \"24a05251-c491-4791-b7a2-75a333a4ede3\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " Jul 13 18:20:43.774797 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774692 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-oauth-serving-cert\") pod \"24a05251-c491-4791-b7a2-75a333a4ede3\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " Jul 13 18:20:43.774797 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774740 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-console-config\") pod \"24a05251-c491-4791-b7a2-75a333a4ede3\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " Jul 13 18:20:43.774797 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774775 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-service-ca\") pod \"24a05251-c491-4791-b7a2-75a333a4ede3\" (UID: \"24a05251-c491-4791-b7a2-75a333a4ede3\") " Jul 13 18:20:43.775081 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.774961 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "24a05251-c491-4791-b7a2-75a333a4ede3" (UID: "24a05251-c491-4791-b7a2-75a333a4ede3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:20:43.775179 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.775148 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "24a05251-c491-4791-b7a2-75a333a4ede3" (UID: "24a05251-c491-4791-b7a2-75a333a4ede3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:20:43.775233 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.775172 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-console-config" (OuterVolumeSpecName: "console-config") pod "24a05251-c491-4791-b7a2-75a333a4ede3" (UID: "24a05251-c491-4791-b7a2-75a333a4ede3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:20:43.775293 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.775259 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-service-ca" (OuterVolumeSpecName: "service-ca") pod "24a05251-c491-4791-b7a2-75a333a4ede3" (UID: "24a05251-c491-4791-b7a2-75a333a4ede3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:20:43.776815 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.776793 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "24a05251-c491-4791-b7a2-75a333a4ede3" (UID: "24a05251-c491-4791-b7a2-75a333a4ede3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:20:43.776815 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.776801 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24a05251-c491-4791-b7a2-75a333a4ede3-kube-api-access-6r5pl" (OuterVolumeSpecName: "kube-api-access-6r5pl") pod "24a05251-c491-4791-b7a2-75a333a4ede3" (UID: "24a05251-c491-4791-b7a2-75a333a4ede3"). InnerVolumeSpecName "kube-api-access-6r5pl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:20:43.776954 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.776831 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "24a05251-c491-4791-b7a2-75a333a4ede3" (UID: "24a05251-c491-4791-b7a2-75a333a4ede3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:20:43.837767 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.837730 2565 generic.go:356] "Generic (PLEG): container finished" podID="24a05251-c491-4791-b7a2-75a333a4ede3" containerID="65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e" exitCode=0 Jul 13 18:20:43.837938 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.837777 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68994f5c-vbjs9" Jul 13 18:20:43.837938 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.837795 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68994f5c-vbjs9" event={"ID":"24a05251-c491-4791-b7a2-75a333a4ede3","Type":"ContainerDied","Data":"65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e"} Jul 13 18:20:43.837938 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.837833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68994f5c-vbjs9" event={"ID":"24a05251-c491-4791-b7a2-75a333a4ede3","Type":"ContainerDied","Data":"7c6d530202cb7308cd9763628ba6b4d201babdb0a7155daeeb1e822eec1fd215"} Jul 13 18:20:43.837938 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.837853 2565 scope.go:117] "RemoveContainer" containerID="65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e" Jul 13 18:20:43.851629 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.851609 2565 scope.go:117] "RemoveContainer" containerID="65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e" Jul 13 18:20:43.851921 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:20:43.851902 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e\": container with ID starting with 65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e not found: ID does not exist" containerID="65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e" Jul 13 18:20:43.851989 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.851929 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e"} err="failed to get container status \"65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e\": rpc error: code = NotFound desc = could not find container \"65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e\": container with ID starting with 65d4070d73ec72fd4f3fdcd5993c818c312280bf9f3e59c47703a688bd16e75e not found: ID does not exist" Jul 13 18:20:43.863912 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.863881 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b68994f5c-vbjs9"] Jul 13 18:20:43.868979 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.868953 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b68994f5c-vbjs9"] Jul 13 18:20:43.875305 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.875288 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-console-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:20:43.875367 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.875307 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-service-ca\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:20:43.875367 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.875316 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-trusted-ca-bundle\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:20:43.875367 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.875326 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r5pl\" (UniqueName: \"kubernetes.io/projected/24a05251-c491-4791-b7a2-75a333a4ede3-kube-api-access-6r5pl\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:20:43.875367 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.875336 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:20:43.875367 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.875344 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/24a05251-c491-4791-b7a2-75a333a4ede3-console-oauth-config\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:20:43.875367 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:43.875352 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/24a05251-c491-4791-b7a2-75a333a4ede3-oauth-serving-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:20:44.991702 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:20:44.991671 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24a05251-c491-4791-b7a2-75a333a4ede3" path="/var/lib/kubelet/pods/24a05251-c491-4791-b7a2-75a333a4ede3/volumes" Jul 13 18:21:06.243411 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:06.243380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:06.459140 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:06.459104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:10.384253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:10.384223 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:10.497686 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:10.497655 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:12.173158 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:12.173126 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:12.500198 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:12.500102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:12.732871 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:12.732840 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:12.948974 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:12.948940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:14.508165 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:14.508123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:15.235814 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:15.235785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:16.967963 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:16.967927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:17.177130 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:17.177101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:23.454740 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:23.454708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:23.909532 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:23.909502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:24.008502 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:24.008469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:25.412049 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412015 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm"] Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412286 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8102fcc-0ccb-4ba5-8c17-00920e98f39a" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412309 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8102fcc-0ccb-4ba5-8c17-00920e98f39a" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412318 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24a05251-c491-4791-b7a2-75a333a4ede3" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412324 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="24a05251-c491-4791-b7a2-75a333a4ede3" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412340 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31f0ad51-6bc5-4c6d-9c2f-ad473574b510" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412346 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="31f0ad51-6bc5-4c6d-9c2f-ad473574b510" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412392 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="31f0ad51-6bc5-4c6d-9c2f-ad473574b510" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412399 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8102fcc-0ccb-4ba5-8c17-00920e98f39a" containerName="console" Jul 13 18:21:25.412419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.412405 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="24a05251-c491-4791-b7a2-75a333a4ede3" containerName="console" Jul 13 18:21:25.414344 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.414328 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.416981 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.416961 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 13 18:21:25.417300 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.417282 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 13 18:21:25.417600 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.417284 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xnskw\"" Jul 13 18:21:25.443526 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.443493 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm"] Jul 13 18:21:25.498173 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.498132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9af14c7e-7b89-4efc-9a82-b5e802162b73-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5cxnm\" (UID: \"9af14c7e-7b89-4efc-9a82-b5e802162b73\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.498173 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.498170 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqxc4\" (UniqueName: \"kubernetes.io/projected/9af14c7e-7b89-4efc-9a82-b5e802162b73-kube-api-access-qqxc4\") pod \"openshift-lws-operator-fd8ccff4c-5cxnm\" (UID: \"9af14c7e-7b89-4efc-9a82-b5e802162b73\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.598805 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.598743 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9af14c7e-7b89-4efc-9a82-b5e802162b73-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5cxnm\" (UID: \"9af14c7e-7b89-4efc-9a82-b5e802162b73\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.599008 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.598824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqxc4\" (UniqueName: \"kubernetes.io/projected/9af14c7e-7b89-4efc-9a82-b5e802162b73-kube-api-access-qqxc4\") pod \"openshift-lws-operator-fd8ccff4c-5cxnm\" (UID: \"9af14c7e-7b89-4efc-9a82-b5e802162b73\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.599996 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.599965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9af14c7e-7b89-4efc-9a82-b5e802162b73-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5cxnm\" (UID: \"9af14c7e-7b89-4efc-9a82-b5e802162b73\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.612952 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.612922 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqxc4\" (UniqueName: \"kubernetes.io/projected/9af14c7e-7b89-4efc-9a82-b5e802162b73-kube-api-access-qqxc4\") pod \"openshift-lws-operator-fd8ccff4c-5cxnm\" (UID: \"9af14c7e-7b89-4efc-9a82-b5e802162b73\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.732327 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.732219 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" Jul 13 18:21:25.861893 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.861869 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm"] Jul 13 18:21:25.864270 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:21:25.864235 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9af14c7e_7b89_4efc_9a82_b5e802162b73.slice/crio-d91654442e9ea340fd11a0e305d77a0eab08230bdd95f9036d371af568fe2144 WatchSource:0}: Error finding container d91654442e9ea340fd11a0e305d77a0eab08230bdd95f9036d371af568fe2144: Status 404 returned error can't find the container with id d91654442e9ea340fd11a0e305d77a0eab08230bdd95f9036d371af568fe2144 Jul 13 18:21:25.988959 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:25.988862 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" event={"ID":"9af14c7e-7b89-4efc-9a82-b5e802162b73","Type":"ContainerStarted","Data":"d91654442e9ea340fd11a0e305d77a0eab08230bdd95f9036d371af568fe2144"} Jul 13 18:21:29.003180 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:29.003139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" event={"ID":"9af14c7e-7b89-4efc-9a82-b5e802162b73","Type":"ContainerStarted","Data":"ed81b773683996b85bfcc0007dbe1e2742164c5ecf0e303926dd697b2fd202c6"} Jul 13 18:21:29.790037 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:29.790002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:29.881223 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:29.881187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:31.981650 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:31.981615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:38.136237 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:38.136198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:39.397121 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:39.397092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:39.469537 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:39.469502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:45.915331 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:45.915295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:46.045528 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:46.045494 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:46.793017 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:46.792984 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:46.915724 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:46.915689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:47.428212 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.428184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:47.729444 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.729366 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:47.862846 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.862815 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:47.904389 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.904331 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5cxnm" podStartSLOduration=20.326660723 podStartE2EDuration="22.904312958s" totalImagesPullingTime="2.577652235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:21:29.037828917 +0000 UTC m=+240.710232737" watchObservedRunningTime="2026-07-13 18:21:47.904312958 +0000 UTC m=+259.576716780" Jul 13 18:21:47.904545 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.904470 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx"] Jul 13 18:21:47.907955 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.907923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:47.910696 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.910677 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 18:21:47.910974 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.910948 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 18:21:47.911085 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.910982 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 18:21:47.911500 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.911483 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-67b8j\"" Jul 13 18:21:47.911605 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.911516 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 18:21:47.931781 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:47.931757 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx"] Jul 13 18:21:48.080373 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.080342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b63c570a-c8d2-4240-a792-cd49b6fe375e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.080574 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.080408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b63c570a-c8d2-4240-a792-cd49b6fe375e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.080574 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.080446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b63c570a-c8d2-4240-a792-cd49b6fe375e-tmp\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.080574 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.080462 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpz8k\" (UniqueName: \"kubernetes.io/projected/b63c570a-c8d2-4240-a792-cd49b6fe375e-kube-api-access-bpz8k\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.080574 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.080481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b63c570a-c8d2-4240-a792-cd49b6fe375e-manifests\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.089786 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.089756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:48.181044 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.181008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b63c570a-c8d2-4240-a792-cd49b6fe375e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.181226 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.181074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b63c570a-c8d2-4240-a792-cd49b6fe375e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.181226 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.181096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b63c570a-c8d2-4240-a792-cd49b6fe375e-tmp\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.181226 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.181116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpz8k\" (UniqueName: \"kubernetes.io/projected/b63c570a-c8d2-4240-a792-cd49b6fe375e-kube-api-access-bpz8k\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.181226 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.181135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b63c570a-c8d2-4240-a792-cd49b6fe375e-manifests\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.181568 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.181549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b63c570a-c8d2-4240-a792-cd49b6fe375e-manifests\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.183392 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.183370 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b63c570a-c8d2-4240-a792-cd49b6fe375e-tmp\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.183740 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.183718 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b63c570a-c8d2-4240-a792-cd49b6fe375e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.183789 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.183766 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b63c570a-c8d2-4240-a792-cd49b6fe375e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.193185 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.193162 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpz8k\" (UniqueName: \"kubernetes.io/projected/b63c570a-c8d2-4240-a792-cd49b6fe375e-kube-api-access-bpz8k\") pod \"opendatahub-operator-controller-manager-6db786db4b-z54rx\" (UID: \"b63c570a-c8d2-4240-a792-cd49b6fe375e\") " pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.195409 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.195384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:48.219551 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.219526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:48.299173 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.299144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:48.373778 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.373756 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx"] Jul 13 18:21:48.374560 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:21:48.374539 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63c570a_c8d2_4240_a792_cd49b6fe375e.slice/crio-0bab52309308f3b83bbe3b7729816e65a0a4b6f8aa5223cffe66ae05619010b1 WatchSource:0}: Error finding container 0bab52309308f3b83bbe3b7729816e65a0a4b6f8aa5223cffe66ae05619010b1: Status 404 returned error can't find the container with id 0bab52309308f3b83bbe3b7729816e65a0a4b6f8aa5223cffe66ae05619010b1 Jul 13 18:21:48.505947 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.505920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:48.670684 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.670606 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:48.773566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:48.773540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:49.079436 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:49.079371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" event={"ID":"b63c570a-c8d2-4240-a792-cd49b6fe375e","Type":"ContainerStarted","Data":"0bab52309308f3b83bbe3b7729816e65a0a4b6f8aa5223cffe66ae05619010b1"} Jul 13 18:21:51.899220 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:51.899188 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:52.009292 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:52.009261 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:21:52.094577 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:52.094537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" event={"ID":"b63c570a-c8d2-4240-a792-cd49b6fe375e","Type":"ContainerStarted","Data":"2d4c775c06270e1f0c97c6dca0635d7b5defb61a4fcdac0711719f5ecec1203c"} Jul 13 18:21:53.099965 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:53.099929 2565 generic.go:356] "Generic (PLEG): container finished" podID="b63c570a-c8d2-4240-a792-cd49b6fe375e" containerID="2d4c775c06270e1f0c97c6dca0635d7b5defb61a4fcdac0711719f5ecec1203c" exitCode=0 Jul 13 18:21:53.100405 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:53.100004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" event={"ID":"b63c570a-c8d2-4240-a792-cd49b6fe375e","Type":"ContainerDied","Data":"2d4c775c06270e1f0c97c6dca0635d7b5defb61a4fcdac0711719f5ecec1203c"} Jul 13 18:21:54.105282 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:54.105248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" event={"ID":"b63c570a-c8d2-4240-a792-cd49b6fe375e","Type":"ContainerStarted","Data":"b6c5fb072df398a7762df1d43e7543ae603b238fd75ab97c78761ea91f3baed9"} Jul 13 18:21:54.105679 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:54.105369 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:21:54.167070 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:21:54.166968 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" podStartSLOduration=2.142374919 podStartE2EDuration="7.166950988s" totalImagesPullingTime="3.879968353s" totalInitContainerRuntime="1.144607716s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:21:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:21:54.164438041 +0000 UTC m=+265.836841888" watchObservedRunningTime="2026-07-13 18:21:54.166950988 +0000 UTC m=+265.839354789" Jul 13 18:22:05.111140 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:05.111110 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6db786db4b-z54rx" Jul 13 18:22:07.713274 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:07.713241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:07.882147 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:07.882115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:08.535438 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.535405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:08.589564 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.589527 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj"] Jul 13 18:22:08.597171 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.597155 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.608475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.608452 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 18:22:08.608635 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.608482 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 18:22:08.608635 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.608507 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 18:22:08.608635 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.608607 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 18:22:08.625892 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.625869 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj"] Jul 13 18:22:08.645663 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.645637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd306fa5-4b2c-436a-933c-9087dce172d8-tls-certs\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.645778 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.645690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd306fa5-4b2c-436a-933c-9087dce172d8-tmp\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.645778 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.645766 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6wpm\" (UniqueName: \"kubernetes.io/projected/fd306fa5-4b2c-436a-933c-9087dce172d8-kube-api-access-w6wpm\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.746424 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.746396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd306fa5-4b2c-436a-933c-9087dce172d8-tls-certs\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.746799 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.746451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd306fa5-4b2c-436a-933c-9087dce172d8-tmp\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.746799 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.746485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6wpm\" (UniqueName: \"kubernetes.io/projected/fd306fa5-4b2c-436a-933c-9087dce172d8-kube-api-access-w6wpm\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.746799 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:22:08.746527 2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 13 18:22:08.746799 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:22:08.746605 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd306fa5-4b2c-436a-933c-9087dce172d8-tls-certs podName:fd306fa5-4b2c-436a-933c-9087dce172d8 nodeName:}" failed. No retries permitted until 2026-07-13 18:22:09.246574458 +0000 UTC m=+280.918978259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fd306fa5-4b2c-436a-933c-9087dce172d8-tls-certs") pod "kube-auth-proxy-bfdc649b5-n5htj" (UID: "fd306fa5-4b2c-436a-933c-9087dce172d8") : secret "kube-auth-proxy-tls" not found Jul 13 18:22:08.748639 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.748620 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd306fa5-4b2c-436a-933c-9087dce172d8-tmp\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:08.768925 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:08.768903 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6wpm\" (UniqueName: \"kubernetes.io/projected/fd306fa5-4b2c-436a-933c-9087dce172d8-kube-api-access-w6wpm\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:09.050276 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:09.050241 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:09.251012 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:09.250966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd306fa5-4b2c-436a-933c-9087dce172d8-tls-certs\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:09.253515 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:09.253487 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd306fa5-4b2c-436a-933c-9087dce172d8-tls-certs\") pod \"kube-auth-proxy-bfdc649b5-n5htj\" (UID: \"fd306fa5-4b2c-436a-933c-9087dce172d8\") " pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:09.260154 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:09.260125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:09.506213 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:09.506129 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" Jul 13 18:22:09.520320 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:09.520292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:09.646243 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:09.646220 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj"] Jul 13 18:22:09.648369 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:22:09.648331 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd306fa5_4b2c_436a_933c_9087dce172d8.slice/crio-2b8904dac66a06136480ef9c6631b8243d30f8b20f364f7e4d5a9439b9aebfc2 WatchSource:0}: Error finding container 2b8904dac66a06136480ef9c6631b8243d30f8b20f364f7e4d5a9439b9aebfc2: Status 404 returned error can't find the container with id 2b8904dac66a06136480ef9c6631b8243d30f8b20f364f7e4d5a9439b9aebfc2 Jul 13 18:22:10.107749 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.107717 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:10.166797 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.166755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" event={"ID":"fd306fa5-4b2c-436a-933c-9087dce172d8","Type":"ContainerStarted","Data":"2b8904dac66a06136480ef9c6631b8243d30f8b20f364f7e4d5a9439b9aebfc2"} Jul 13 18:22:10.286101 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.286073 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lrj54"] Jul 13 18:22:10.289291 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.289275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:10.293206 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.293181 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 13 18:22:10.306789 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.306766 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:10.325258 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.325231 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lrj54"] Jul 13 18:22:10.361200 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.361120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55lm5\" (UniqueName: \"kubernetes.io/projected/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-kube-api-access-55lm5\") pod \"model-serving-api-54d89bd5fc-lrj54\" (UID: \"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48\") " pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:10.361200 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.361177 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-tls-certs\") pod \"model-serving-api-54d89bd5fc-lrj54\" (UID: \"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48\") " pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:10.462634 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.462573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55lm5\" (UniqueName: \"kubernetes.io/projected/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-kube-api-access-55lm5\") pod \"model-serving-api-54d89bd5fc-lrj54\" (UID: \"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48\") " pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:10.462817 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.462688 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-tls-certs\") pod \"model-serving-api-54d89bd5fc-lrj54\" (UID: \"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48\") " pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:10.462817 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:22:10.462803 2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 13 18:22:10.462977 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:22:10.462873 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-tls-certs podName:2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48 nodeName:}" failed. No retries permitted until 2026-07-13 18:22:10.962851019 +0000 UTC m=+282.635254821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-tls-certs") pod "model-serving-api-54d89bd5fc-lrj54" (UID: "2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48") : secret "model-serving-api-tls" not found Jul 13 18:22:10.478901 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.478864 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55lm5\" (UniqueName: \"kubernetes.io/projected/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-kube-api-access-55lm5\") pod \"model-serving-api-54d89bd5fc-lrj54\" (UID: \"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48\") " pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:10.770033 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.769950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:10.966724 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.966680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-tls-certs\") pod \"model-serving-api-54d89bd5fc-lrj54\" (UID: \"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48\") " pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:10.969316 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:10.969294 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48-tls-certs\") pod \"model-serving-api-54d89bd5fc-lrj54\" (UID: \"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48\") " pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:11.199455 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.199422 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:11.200193 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.200169 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh"] Jul 13 18:22:11.202331 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.202317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.203768 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.203742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:11.210723 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.210700 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t7dpj\"" Jul 13 18:22:11.211054 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.210927 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 18:22:11.211054 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.210968 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 18:22:11.211325 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.211303 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 18:22:11.214161 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.214146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 18:22:11.227155 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.227130 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh"] Jul 13 18:22:11.270520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.270201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.270520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.270245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.270520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.270284 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-cacerts\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.270520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.270337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7wnb\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-kube-api-access-k7wnb\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.270520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.270383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.270520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.270442 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-token\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.270520 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.270474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482cf42-c9b6-4048-9f8d-50fb90f6d510-local-certs\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.331816 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.331780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:11.366253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.366225 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lrj54"] Jul 13 18:22:11.369735 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:22:11.369706 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea5c3a6_91a5_4bd6_a47a_238ea2d77e48.slice/crio-8d81d0d45a0b99862d9f1ec3c5896f05ee4996377cb71b7b09191cb330e2b5a7 WatchSource:0}: Error finding container 8d81d0d45a0b99862d9f1ec3c5896f05ee4996377cb71b7b09191cb330e2b5a7: Status 404 returned error can't find the container with id 8d81d0d45a0b99862d9f1ec3c5896f05ee4996377cb71b7b09191cb330e2b5a7 Jul 13 18:22:11.370982 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.370958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-token\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.371089 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.370991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482cf42-c9b6-4048-9f8d-50fb90f6d510-local-certs\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.371089 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.371014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.371200 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.371119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.371200 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.371161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-cacerts\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.371304 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.371206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7wnb\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-kube-api-access-k7wnb\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.371304 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.371250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.371908 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.371842 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.373784 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.373765 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482cf42-c9b6-4048-9f8d-50fb90f6d510-local-certs\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.373784 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.373772 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-cacerts\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.373917 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.373798 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.373917 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.373846 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.396611 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.396566 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-token\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.398824 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.398799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7wnb\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-kube-api-access-k7wnb\") pod \"istiod-openshift-gateway-7574459656-xv6dh\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.528016 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.527939 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:11.661725 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:11.661683 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh"] Jul 13 18:22:11.666078 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:22:11.666053 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda482cf42_c9b6_4048_9f8d_50fb90f6d510.slice/crio-74b7945e74067ee03a2a545847918a9b44f54af7bbf196d0d372d80c132272c6 WatchSource:0}: Error finding container 74b7945e74067ee03a2a545847918a9b44f54af7bbf196d0d372d80c132272c6: Status 404 returned error can't find the container with id 74b7945e74067ee03a2a545847918a9b44f54af7bbf196d0d372d80c132272c6 Jul 13 18:22:12.176203 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:12.176162 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" event={"ID":"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48","Type":"ContainerStarted","Data":"8d81d0d45a0b99862d9f1ec3c5896f05ee4996377cb71b7b09191cb330e2b5a7"} Jul 13 18:22:12.182389 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:12.182355 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" event={"ID":"a482cf42-c9b6-4048-9f8d-50fb90f6d510","Type":"ContainerStarted","Data":"74b7945e74067ee03a2a545847918a9b44f54af7bbf196d0d372d80c132272c6"} Jul 13 18:22:12.803116 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:12.803079 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:14.938310 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:14.938280 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:22:14.938598 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:14.938339 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 18:22:15.199825 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.199733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" event={"ID":"fd306fa5-4b2c-436a-933c-9087dce172d8","Type":"ContainerStarted","Data":"5570d32768b2a2a8dd206356b041beaf05089930ad0c850cf1e715f762f5df87"} Jul 13 18:22:15.201229 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.201204 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" event={"ID":"2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48","Type":"ContainerStarted","Data":"d5c64db1b1ff646b7528d6c606b113a502fa4357d6cffb00212116ca90db5a99"} Jul 13 18:22:15.201365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.201291 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:15.202807 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.202785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" event={"ID":"a482cf42-c9b6-4048-9f8d-50fb90f6d510","Type":"ContainerStarted","Data":"7cdcc3d9d7d3ed93141501801d86cc31484a63408e2acf4b3876ea8922c8527a"} Jul 13 18:22:15.202923 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.202908 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:15.222993 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.222941 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bfdc649b5-n5htj" podStartSLOduration=1.937366031 podStartE2EDuration="7.222927641s" totalImagesPullingTime="5.28556161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:22:15.220954758 +0000 UTC m=+286.893358581" watchObservedRunningTime="2026-07-13 18:22:15.222927641 +0000 UTC m=+286.895331463" Jul 13 18:22:15.244473 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.244424 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" podStartSLOduration=1.677716314 podStartE2EDuration="5.244410735s" totalImagesPullingTime="3.566694421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:22:15.24354515 +0000 UTC m=+286.915948974" watchObservedRunningTime="2026-07-13 18:22:15.244410735 +0000 UTC m=+286.916814599" Jul 13 18:22:15.278789 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.278736 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" podStartSLOduration=1.008664784 podStartE2EDuration="4.278715247s" totalImagesPullingTime="3.270050463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:22:15.278378339 +0000 UTC m=+286.950782161" watchObservedRunningTime="2026-07-13 18:22:15.278715247 +0000 UTC m=+286.951119052" Jul 13 18:22:15.931938 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:15.931906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:16.116765 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:16.116724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:16.212076 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:16.212005 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:17.507307 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:17.507277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:18.772382 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.772349 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn"] Jul 13 18:22:18.776576 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.776532 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.782144 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.782124 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 13 18:22:18.782283 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.782124 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 13 18:22:18.782283 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.782125 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 13 18:22:18.782923 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.782908 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pm642\"" Jul 13 18:22:18.794747 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.794475 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn"] Jul 13 18:22:18.838731 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.838701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z446m\" (UniqueName: \"kubernetes.io/projected/34b2c725-1d4e-466b-a950-dce80da9884c-kube-api-access-z446m\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.838872 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.838743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34b2c725-1d4e-466b-a950-dce80da9884c-cert\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.838872 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.838779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/34b2c725-1d4e-466b-a950-dce80da9884c-metrics-cert\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.838872 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.838827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/34b2c725-1d4e-466b-a950-dce80da9884c-manager-config\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.939850 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.939812 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/34b2c725-1d4e-466b-a950-dce80da9884c-manager-config\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.940036 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.939867 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z446m\" (UniqueName: \"kubernetes.io/projected/34b2c725-1d4e-466b-a950-dce80da9884c-kube-api-access-z446m\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.940036 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.939907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34b2c725-1d4e-466b-a950-dce80da9884c-cert\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.940036 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.939959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/34b2c725-1d4e-466b-a950-dce80da9884c-metrics-cert\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.940434 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.940413 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/34b2c725-1d4e-466b-a950-dce80da9884c-manager-config\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.942229 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.942209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/34b2c725-1d4e-466b-a950-dce80da9884c-metrics-cert\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.942342 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.942323 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34b2c725-1d4e-466b-a950-dce80da9884c-cert\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:18.948939 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:18.948915 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z446m\" (UniqueName: \"kubernetes.io/projected/34b2c725-1d4e-466b-a950-dce80da9884c-kube-api-access-z446m\") pod \"lws-controller-manager-8cf789686-vr4bn\" (UID: \"34b2c725-1d4e-466b-a950-dce80da9884c\") " pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:19.087910 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:19.087874 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:19.239094 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:19.239060 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn"] Jul 13 18:22:19.242922 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:22:19.242892 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b2c725_1d4e_466b_a950_dce80da9884c.slice/crio-08e01955abf641db85571708c1596916879e7b77234df9e93756c5ddd11b05ac WatchSource:0}: Error finding container 08e01955abf641db85571708c1596916879e7b77234df9e93756c5ddd11b05ac: Status 404 returned error can't find the container with id 08e01955abf641db85571708c1596916879e7b77234df9e93756c5ddd11b05ac Jul 13 18:22:20.228475 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:20.228439 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" event={"ID":"34b2c725-1d4e-466b-a950-dce80da9884c","Type":"ContainerStarted","Data":"08e01955abf641db85571708c1596916879e7b77234df9e93756c5ddd11b05ac"} Jul 13 18:22:21.234412 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.234376 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" event={"ID":"34b2c725-1d4e-466b-a950-dce80da9884c","Type":"ContainerStarted","Data":"f4f986d8534b517e2c4132c754332c4f25e4da2d8c2b2f6efdf35c5bcbea279f"} Jul 13 18:22:21.234834 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.234442 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:21.289536 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.289499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:21.330738 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.330688 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" podStartSLOduration=1.58227048 podStartE2EDuration="3.330670851s" totalImagesPullingTime="1.748400371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:22:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:22:21.329956618 +0000 UTC m=+293.002360441" watchObservedRunningTime="2026-07-13 18:22:21.330670851 +0000 UTC m=+293.003074674" Jul 13 18:22:21.530102 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.530072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:21.661222 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.661136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:21.756610 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.756559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:21.990793 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:21.990703 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:22:24.092976 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.092939 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh"] Jul 13 18:22:24.093399 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.093142 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" podUID="a482cf42-c9b6-4048-9f8d-50fb90f6d510" containerName="discovery" containerID="cri-o://7cdcc3d9d7d3ed93141501801d86cc31484a63408e2acf4b3876ea8922c8527a" gracePeriod=30 Jul 13 18:22:24.248604 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.248550 2565 generic.go:356] "Generic (PLEG): container finished" podID="a482cf42-c9b6-4048-9f8d-50fb90f6d510" containerID="7cdcc3d9d7d3ed93141501801d86cc31484a63408e2acf4b3876ea8922c8527a" exitCode=0 Jul 13 18:22:24.248762 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.248626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" event={"ID":"a482cf42-c9b6-4048-9f8d-50fb90f6d510","Type":"ContainerDied","Data":"7cdcc3d9d7d3ed93141501801d86cc31484a63408e2acf4b3876ea8922c8527a"} Jul 13 18:22:24.831992 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.831970 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:24.893927 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.893899 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-ca-configmap\") pod \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " Jul 13 18:22:24.894113 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.893944 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482cf42-c9b6-4048-9f8d-50fb90f6d510-local-certs\") pod \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " Jul 13 18:22:24.894113 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.893984 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-kubeconfig\") pod \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " Jul 13 18:22:24.894113 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.894014 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7wnb\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-kube-api-access-k7wnb\") pod \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " Jul 13 18:22:24.894113 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.894039 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-dns-cert\") pod \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " Jul 13 18:22:24.894113 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.894063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-cacerts\") pod \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " Jul 13 18:22:24.894113 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.894107 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-token\") pod \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\" (UID: \"a482cf42-c9b6-4048-9f8d-50fb90f6d510\") " Jul 13 18:22:24.894408 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.894366 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a482cf42-c9b6-4048-9f8d-50fb90f6d510" (UID: "a482cf42-c9b6-4048-9f8d-50fb90f6d510"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 18:22:24.896515 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.896483 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a482cf42-c9b6-4048-9f8d-50fb90f6d510" (UID: "a482cf42-c9b6-4048-9f8d-50fb90f6d510"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:22:24.896515 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.896497 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-token" (OuterVolumeSpecName: "istio-token") pod "a482cf42-c9b6-4048-9f8d-50fb90f6d510" (UID: "a482cf42-c9b6-4048-9f8d-50fb90f6d510"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:22:24.896515 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.896509 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a482cf42-c9b6-4048-9f8d-50fb90f6d510-local-certs" (OuterVolumeSpecName: "local-certs") pod "a482cf42-c9b6-4048-9f8d-50fb90f6d510" (UID: "a482cf42-c9b6-4048-9f8d-50fb90f6d510"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:22:24.896736 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.896604 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-kube-api-access-k7wnb" (OuterVolumeSpecName: "kube-api-access-k7wnb") pod "a482cf42-c9b6-4048-9f8d-50fb90f6d510" (UID: "a482cf42-c9b6-4048-9f8d-50fb90f6d510"). InnerVolumeSpecName "kube-api-access-k7wnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:22:24.896736 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.896690 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a482cf42-c9b6-4048-9f8d-50fb90f6d510" (UID: "a482cf42-c9b6-4048-9f8d-50fb90f6d510"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:22:24.896809 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.896736 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-cacerts" (OuterVolumeSpecName: "cacerts") pod "a482cf42-c9b6-4048-9f8d-50fb90f6d510" (UID: "a482cf42-c9b6-4048-9f8d-50fb90f6d510"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:22:24.995618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.995514 2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-kubeconfig\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:22:24.995618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.995539 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7wnb\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-kube-api-access-k7wnb\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:22:24.995618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.995550 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-dns-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:22:24.995618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.995559 2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a482cf42-c9b6-4048-9f8d-50fb90f6d510-cacerts\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:22:24.995618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.995568 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-token\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:22:24.995618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.995577 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a482cf42-c9b6-4048-9f8d-50fb90f6d510-istio-csr-ca-configmap\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:22:24.995618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:24.995597 2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482cf42-c9b6-4048-9f8d-50fb90f6d510-local-certs\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:22:25.254450 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:25.254369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" event={"ID":"a482cf42-c9b6-4048-9f8d-50fb90f6d510","Type":"ContainerDied","Data":"74b7945e74067ee03a2a545847918a9b44f54af7bbf196d0d372d80c132272c6"} Jul 13 18:22:25.254450 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:25.254418 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh" Jul 13 18:22:25.254450 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:25.254430 2565 scope.go:117] "RemoveContainer" containerID="7cdcc3d9d7d3ed93141501801d86cc31484a63408e2acf4b3876ea8922c8527a" Jul 13 18:22:25.299502 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:25.299468 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh"] Jul 13 18:22:25.305434 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:25.305404 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-xv6dh"] Jul 13 18:22:26.215155 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:26.215117 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lrj54" Jul 13 18:22:26.993014 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:26.992973 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a482cf42-c9b6-4048-9f8d-50fb90f6d510" path="/var/lib/kubelet/pods/a482cf42-c9b6-4048-9f8d-50fb90f6d510/volumes" Jul 13 18:22:28.782220 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:28.782189 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:22:28.785779 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:28.785761 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:22:28.790345 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:28.790325 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 18:22:32.241752 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:32.241723 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8cf789686-vr4bn" Jul 13 18:22:50.594414 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:22:50.594378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:03.167171 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:03.167140 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:09.291298 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:09.291260 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:09.383032 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:09.382989 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:09.506942 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:09.506902 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:10.220373 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:10.220344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:10.721005 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:10.720973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:39.937702 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:39.937671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:43.391229 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:43.391191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:44.152938 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:44.152907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:47.481503 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:47.481468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:47.585350 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:47.585315 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:47.809367 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:47.809329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:49.214245 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.214209 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:49.906626 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.906596 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb"] Jul 13 18:23:49.906899 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.906887 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a482cf42-c9b6-4048-9f8d-50fb90f6d510" containerName="discovery" Jul 13 18:23:49.906949 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.906903 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a482cf42-c9b6-4048-9f8d-50fb90f6d510" containerName="discovery" Jul 13 18:23:49.907017 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.907005 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a482cf42-c9b6-4048-9f8d-50fb90f6d510" containerName="discovery" Jul 13 18:23:49.909728 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.909713 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" Jul 13 18:23:49.912045 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.912023 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 13 18:23:49.912568 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.912552 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-m4wkk\"" Jul 13 18:23:49.912867 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.912852 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 18:23:49.913760 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.913746 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 18:23:49.920940 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:49.920919 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb"] Jul 13 18:23:50.004278 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.004247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn92q\" (UniqueName: \"kubernetes.io/projected/3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe-kube-api-access-jn92q\") pod \"dns-operator-controller-manager-864dd78c4c-2tmvb\" (UID: \"3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" Jul 13 18:23:50.104829 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.104793 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn92q\" (UniqueName: \"kubernetes.io/projected/3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe-kube-api-access-jn92q\") pod \"dns-operator-controller-manager-864dd78c4c-2tmvb\" (UID: \"3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" Jul 13 18:23:50.120108 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.120080 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn92q\" (UniqueName: \"kubernetes.io/projected/3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe-kube-api-access-jn92q\") pod \"dns-operator-controller-manager-864dd78c4c-2tmvb\" (UID: \"3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" Jul 13 18:23:50.219366 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.219274 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" Jul 13 18:23:50.378627 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.378593 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb"] Jul 13 18:23:50.383060 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:23:50.383034 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1bc2fb_c62a_4a61_b04c_7c287b9eedfe.slice/crio-f9a6ca2eaeaa16f9f99a4ebc01a1329aab36b847c691b61227bbf9f85a34a8c1 WatchSource:0}: Error finding container f9a6ca2eaeaa16f9f99a4ebc01a1329aab36b847c691b61227bbf9f85a34a8c1: Status 404 returned error can't find the container with id f9a6ca2eaeaa16f9f99a4ebc01a1329aab36b847c691b61227bbf9f85a34a8c1 Jul 13 18:23:50.385523 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.385508 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 18:23:50.568618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.568576 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:50.612101 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:50.612066 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" event={"ID":"3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe","Type":"ContainerStarted","Data":"f9a6ca2eaeaa16f9f99a4ebc01a1329aab36b847c691b61227bbf9f85a34a8c1"} Jul 13 18:23:51.599706 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:51.599668 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:53.629725 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:53.629688 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" event={"ID":"3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe","Type":"ContainerStarted","Data":"7678b0529d707686fcf5df9f1c4b6f59c808089ba315da19f50279ee4fc31410"} Jul 13 18:23:53.630246 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:53.629843 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" Jul 13 18:23:53.652712 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:53.652667 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" podStartSLOduration=1.984482004 podStartE2EDuration="4.65265324s" totalImagesPullingTime="2.668171236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:23:53.650424218 +0000 UTC m=+385.322828043" watchObservedRunningTime="2026-07-13 18:23:53.65265324 +0000 UTC m=+385.325057063" Jul 13 18:23:55.008512 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.008482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:55.059429 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.059392 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp"] Jul 13 18:23:55.062814 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.062792 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.069073 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.068854 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ww8xf\"" Jul 13 18:23:55.077286 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.077258 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp"] Jul 13 18:23:55.147487 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.147451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lk6\" (UniqueName: \"kubernetes.io/projected/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-kube-api-access-t2lk6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.147677 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.147503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.248605 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.248542 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lk6\" (UniqueName: \"kubernetes.io/projected/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-kube-api-access-t2lk6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.248605 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.248607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.249040 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.249019 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.260698 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.260634 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lk6\" (UniqueName: \"kubernetes.io/projected/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-kube-api-access-t2lk6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.372949 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.372898 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:23:55.511864 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.511776 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp"] Jul 13 18:23:55.514723 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:23:55.514696 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d2c9ff_921c_4f7f_b5ad_15515e2b4dbf.slice/crio-452968f661b361a4db2e8259432e9687410da883a9b2657348bbe60987c067f6 WatchSource:0}: Error finding container 452968f661b361a4db2e8259432e9687410da883a9b2657348bbe60987c067f6: Status 404 returned error can't find the container with id 452968f661b361a4db2e8259432e9687410da883a9b2657348bbe60987c067f6 Jul 13 18:23:55.640143 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:55.640109 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" event={"ID":"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf","Type":"ContainerStarted","Data":"452968f661b361a4db2e8259432e9687410da883a9b2657348bbe60987c067f6"} Jul 13 18:23:56.045667 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:56.045632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:56.141972 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:56.141923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:56.626743 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:56.626708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:23:56.760756 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:23:56.760722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:00.559971 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:00.559925 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:00.664860 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:00.664825 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:01.006255 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:01.006151 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:01.163750 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:01.163710 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:03.676946 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:03.676907 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" event={"ID":"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf","Type":"ContainerStarted","Data":"c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d"} Jul 13 18:24:03.677276 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:03.677046 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:03.731262 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:03.731206 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" podStartSLOduration=0.643354445 podStartE2EDuration="8.731191607s" totalImagesPullingTime="8.087837162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:24:03.72994597 +0000 UTC m=+395.402349784" watchObservedRunningTime="2026-07-13 18:24:03.731191607 +0000 UTC m=+395.403595429" Jul 13 18:24:04.008630 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:04.008539 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:04.105727 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:04.105701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:04.636671 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:04.636635 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2tmvb" Jul 13 18:24:06.253767 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.253705 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5"] Jul 13 18:24:06.257150 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.257127 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.262379 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.262356 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 13 18:24:06.262506 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.262400 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jnrp6\"" Jul 13 18:24:06.262662 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.262647 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 13 18:24:06.267833 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.267813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5"] Jul 13 18:24:06.275134 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.275113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:06.346161 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.346128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9c64a13f-c509-48f8-86cc-d1d06348860a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.346161 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.346162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgwx8\" (UniqueName: \"kubernetes.io/projected/9c64a13f-c509-48f8-86cc-d1d06348860a-kube-api-access-qgwx8\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.346359 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.346202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c64a13f-c509-48f8-86cc-d1d06348860a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.446758 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.446722 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9c64a13f-c509-48f8-86cc-d1d06348860a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.446758 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.446756 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgwx8\" (UniqueName: \"kubernetes.io/projected/9c64a13f-c509-48f8-86cc-d1d06348860a-kube-api-access-qgwx8\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.446971 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.446809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c64a13f-c509-48f8-86cc-d1d06348860a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.447472 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.447450 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9c64a13f-c509-48f8-86cc-d1d06348860a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.449217 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.449191 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c64a13f-c509-48f8-86cc-d1d06348860a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.455116 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.455095 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgwx8\" (UniqueName: \"kubernetes.io/projected/9c64a13f-c509-48f8-86cc-d1d06348860a-kube-api-access-qgwx8\") pod \"kuadrant-console-plugin-66b5774985-rg8l5\" (UID: \"9c64a13f-c509-48f8-86cc-d1d06348860a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.566429 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.566395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" Jul 13 18:24:06.708017 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:06.707995 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5"] Jul 13 18:24:06.709627 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:24:06.709603 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c64a13f_c509_48f8_86cc_d1d06348860a.slice/crio-1d9aacdc469210d613ab877e1e865655d6a73addfa957043520124d8bb505946 WatchSource:0}: Error finding container 1d9aacdc469210d613ab877e1e865655d6a73addfa957043520124d8bb505946: Status 404 returned error can't find the container with id 1d9aacdc469210d613ab877e1e865655d6a73addfa957043520124d8bb505946 Jul 13 18:24:07.353937 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:07.353901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:07.453863 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:07.453823 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:07.697743 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:07.697630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" event={"ID":"9c64a13f-c509-48f8-86cc-d1d06348860a","Type":"ContainerStarted","Data":"1d9aacdc469210d613ab877e1e865655d6a73addfa957043520124d8bb505946"} Jul 13 18:24:07.969429 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:07.969286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:08.070780 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:08.070742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:14.631905 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:14.631861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:14.685302 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:14.685254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:14.720085 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:14.720059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:16.575632 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.575596 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp"] Jul 13 18:24:16.576085 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.575830 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" containerName="manager" containerID="cri-o://c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d" gracePeriod=2 Jul 13 18:24:16.580549 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.580517 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp"] Jul 13 18:24:16.871294 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.871212 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh"] Jul 13 18:24:16.871641 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.871626 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" containerName="manager" Jul 13 18:24:16.871641 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.871642 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" containerName="manager" Jul 13 18:24:16.871774 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.871728 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" containerName="manager" Jul 13 18:24:16.875077 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.875059 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:16.880773 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:24:16.880745 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" is forbidden: User \"system:node:ip-10-0-133-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-129.ec2.internal' and this object" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:16.894492 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.894465 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh"] Jul 13 18:24:16.949890 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.949854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjlzf\" (UniqueName: \"kubernetes.io/projected/c0ab018b-579b-49b2-9805-29a7831c9bce-kube-api-access-pjlzf\") pod \"kuadrant-operator-controller-manager-86878c769f-884gh\" (UID: \"c0ab018b-579b-49b2-9805-29a7831c9bce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:16.950059 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:16.949952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ab018b-579b-49b2-9805-29a7831c9bce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-884gh\" (UID: \"c0ab018b-579b-49b2-9805-29a7831c9bce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:17.050795 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:17.050755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjlzf\" (UniqueName: \"kubernetes.io/projected/c0ab018b-579b-49b2-9805-29a7831c9bce-kube-api-access-pjlzf\") pod \"kuadrant-operator-controller-manager-86878c769f-884gh\" (UID: \"c0ab018b-579b-49b2-9805-29a7831c9bce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:17.050997 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:17.050844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ab018b-579b-49b2-9805-29a7831c9bce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-884gh\" (UID: \"c0ab018b-579b-49b2-9805-29a7831c9bce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:17.051306 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:17.051280 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0ab018b-579b-49b2-9805-29a7831c9bce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-884gh\" (UID: \"c0ab018b-579b-49b2-9805-29a7831c9bce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:17.078419 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:17.078383 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjlzf\" (UniqueName: \"kubernetes.io/projected/c0ab018b-579b-49b2-9805-29a7831c9bce-kube-api-access-pjlzf\") pod \"kuadrant-operator-controller-manager-86878c769f-884gh\" (UID: \"c0ab018b-579b-49b2-9805-29a7831c9bce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:17.188263 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:17.188170 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:18.441997 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:18.441960 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:18.546405 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:18.546373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:18.660959 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:18.660930 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:18.754246 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:18.754152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:22.597684 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:22.597646 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:22.701779 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:22.701746 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:28.022138 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:28.022068 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:28.125812 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:28.125778 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:30.085945 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.085912 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh"] Jul 13 18:24:30.089848 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:24:30.089814 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ab018b_579b_49b2_9805_29a7831c9bce.slice/crio-b9fca1b4d9d1d093d066752bf92f072a1e2403cd2a6fad451452cd5d28143ab1 WatchSource:0}: Error finding container b9fca1b4d9d1d093d066752bf92f072a1e2403cd2a6fad451452cd5d28143ab1: Status 404 returned error can't find the container with id b9fca1b4d9d1d093d066752bf92f072a1e2403cd2a6fad451452cd5d28143ab1 Jul 13 18:24:30.133978 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.133956 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:30.136003 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:24:30.135980 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" is forbidden: User \"system:node:ip-10-0-133-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-129.ec2.internal' and this object" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:30.276805 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.276737 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2lk6\" (UniqueName: \"kubernetes.io/projected/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-kube-api-access-t2lk6\") pod \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " Jul 13 18:24:30.276942 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.276813 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-extensions-socket-volume\") pod \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\" (UID: \"f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf\") " Jul 13 18:24:30.277239 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.277216 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" (UID: "f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 18:24:30.279007 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.278987 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-kube-api-access-t2lk6" (OuterVolumeSpecName: "kube-api-access-t2lk6") pod "f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" (UID: "f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf"). InnerVolumeSpecName "kube-api-access-t2lk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:24:30.378526 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.378505 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2lk6\" (UniqueName: \"kubernetes.io/projected/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-kube-api-access-t2lk6\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:24:30.378526 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.378526 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf-extensions-socket-volume\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:24:30.822609 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.822551 2565 generic.go:356] "Generic (PLEG): container finished" podID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" containerID="c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d" exitCode=0 Jul 13 18:24:30.822810 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.822629 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:30.822810 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.822648 2565 scope.go:117] "RemoveContainer" containerID="c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d" Jul 13 18:24:30.824349 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.824316 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" event={"ID":"9c64a13f-c509-48f8-86cc-d1d06348860a","Type":"ContainerStarted","Data":"8126341b00e1af6a136845f562a299ec91e2715ea68fedb04b43e2374a28fe3d"} Jul 13 18:24:30.824862 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:24:30.824829 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" is forbidden: User \"system:node:ip-10-0-133-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-129.ec2.internal' and this object" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:30.825965 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.825939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" event={"ID":"c0ab018b-579b-49b2-9805-29a7831c9bce","Type":"ContainerStarted","Data":"d43d3bcb3f1e9608c3560f0cd266012513066dcc48e61c113e1b2b15c0cbee5f"} Jul 13 18:24:30.826088 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.826025 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" event={"ID":"c0ab018b-579b-49b2-9805-29a7831c9bce","Type":"ContainerStarted","Data":"b9fca1b4d9d1d093d066752bf92f072a1e2403cd2a6fad451452cd5d28143ab1"} Jul 13 18:24:30.826088 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.826050 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:30.831425 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.831410 2565 scope.go:117] "RemoveContainer" containerID="c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d" Jul 13 18:24:30.831688 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:24:30.831672 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d\": container with ID starting with c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d not found: ID does not exist" containerID="c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d" Jul 13 18:24:30.831740 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.831696 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d"} err="failed to get container status \"c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d\": rpc error: code = NotFound desc = could not find container \"c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d\": container with ID starting with c43c9c94596101f785e6fce1ba88817e2cc372af5a0de03087f569100582fa2d not found: ID does not exist" Jul 13 18:24:30.843859 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.843816 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rg8l5" podStartSLOduration=1.194020457 podStartE2EDuration="24.843803205s" totalImagesPullingTime="23.649782748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:24:30.842555912 +0000 UTC m=+422.514959735" watchObservedRunningTime="2026-07-13 18:24:30.843803205 +0000 UTC m=+422.516207005" Jul 13 18:24:30.844668 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:24:30.844643 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" is forbidden: User \"system:node:ip-10-0-133-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-129.ec2.internal' and this object" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:30.846653 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:24:30.846634 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-d2dcp\" is forbidden: User \"system:node:ip-10-0-133-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-129.ec2.internal' and this object" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-d2dcp" Jul 13 18:24:30.873795 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.873715 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" podStartSLOduration=14.873694545 podStartE2EDuration="14.873694545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:24:30.873605822 +0000 UTC m=+422.546009646" watchObservedRunningTime="2026-07-13 18:24:30.873694545 +0000 UTC m=+422.546098370" Jul 13 18:24:30.994688 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:30.994660 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf" path="/var/lib/kubelet/pods/f7d2c9ff-921c-4f7f-b5ad-15515e2b4dbf/volumes" Jul 13 18:24:41.833420 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:41.833391 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-884gh" Jul 13 18:24:58.349198 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:58.349156 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:58.745456 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:58.745346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:24:59.956631 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:24:59.956562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:00.063846 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:00.063809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:00.159191 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:00.159150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:00.839080 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:00.839049 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7c5dp"] Jul 13 18:25:00.886192 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:00.886164 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:01.030455 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.030414 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:01.057644 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.057615 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7c5dp" Jul 13 18:25:01.061052 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.061031 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bvf57\"" Jul 13 18:25:01.064182 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.064161 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7c5dp"] Jul 13 18:25:01.106612 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.106526 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-d87d5"] Jul 13 18:25:01.109199 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.109184 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d87d5" Jul 13 18:25:01.137446 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.137393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wm9w\" (UniqueName: \"kubernetes.io/projected/de1eb138-9964-4ad7-bc7e-30496147abdc-kube-api-access-8wm9w\") pod \"authorino-58cd955675-7c5dp\" (UID: \"de1eb138-9964-4ad7-bc7e-30496147abdc\") " pod="kuadrant-system/authorino-58cd955675-7c5dp" Jul 13 18:25:01.139607 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.139564 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d87d5"] Jul 13 18:25:01.238344 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.238318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wm9w\" (UniqueName: \"kubernetes.io/projected/de1eb138-9964-4ad7-bc7e-30496147abdc-kube-api-access-8wm9w\") pod \"authorino-58cd955675-7c5dp\" (UID: \"de1eb138-9964-4ad7-bc7e-30496147abdc\") " pod="kuadrant-system/authorino-58cd955675-7c5dp" Jul 13 18:25:01.238507 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.238363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727tb\" (UniqueName: \"kubernetes.io/projected/031863b6-0002-407e-bc22-c495541a3b54-kube-api-access-727tb\") pod \"authorino-75d556bd77-d87d5\" (UID: \"031863b6-0002-407e-bc22-c495541a3b54\") " pod="kuadrant-system/authorino-75d556bd77-d87d5" Jul 13 18:25:01.256152 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.256124 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wm9w\" (UniqueName: \"kubernetes.io/projected/de1eb138-9964-4ad7-bc7e-30496147abdc-kube-api-access-8wm9w\") pod \"authorino-58cd955675-7c5dp\" (UID: \"de1eb138-9964-4ad7-bc7e-30496147abdc\") " pod="kuadrant-system/authorino-58cd955675-7c5dp" Jul 13 18:25:01.338837 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.338799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-727tb\" (UniqueName: \"kubernetes.io/projected/031863b6-0002-407e-bc22-c495541a3b54-kube-api-access-727tb\") pod \"authorino-75d556bd77-d87d5\" (UID: \"031863b6-0002-407e-bc22-c495541a3b54\") " pod="kuadrant-system/authorino-75d556bd77-d87d5" Jul 13 18:25:01.362874 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.362802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-727tb\" (UniqueName: \"kubernetes.io/projected/031863b6-0002-407e-bc22-c495541a3b54-kube-api-access-727tb\") pod \"authorino-75d556bd77-d87d5\" (UID: \"031863b6-0002-407e-bc22-c495541a3b54\") " pod="kuadrant-system/authorino-75d556bd77-d87d5" Jul 13 18:25:01.366544 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.366517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7c5dp" Jul 13 18:25:01.417808 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.417762 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d87d5" Jul 13 18:25:01.511801 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.511772 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7c5dp"] Jul 13 18:25:01.514673 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:25:01.514644 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde1eb138_9964_4ad7_bc7e_30496147abdc.slice/crio-280be565a241cc30f0ec6a18821e3115cb00a9e986d46a79998b883d906866d7 WatchSource:0}: Error finding container 280be565a241cc30f0ec6a18821e3115cb00a9e986d46a79998b883d906866d7: Status 404 returned error can't find the container with id 280be565a241cc30f0ec6a18821e3115cb00a9e986d46a79998b883d906866d7 Jul 13 18:25:01.563706 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.563678 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d87d5"] Jul 13 18:25:01.567206 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:25:01.567180 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod031863b6_0002_407e_bc22_c495541a3b54.slice/crio-75104193dcfd167505ed39bcfd8ac58bb92c99e3ab1f45f134b96e0b723687da WatchSource:0}: Error finding container 75104193dcfd167505ed39bcfd8ac58bb92c99e3ab1f45f134b96e0b723687da: Status 404 returned error can't find the container with id 75104193dcfd167505ed39bcfd8ac58bb92c99e3ab1f45f134b96e0b723687da Jul 13 18:25:01.968105 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.968069 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7c5dp" event={"ID":"de1eb138-9964-4ad7-bc7e-30496147abdc","Type":"ContainerStarted","Data":"280be565a241cc30f0ec6a18821e3115cb00a9e986d46a79998b883d906866d7"} Jul 13 18:25:01.969127 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:01.969107 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d87d5" event={"ID":"031863b6-0002-407e-bc22-c495541a3b54","Type":"ContainerStarted","Data":"75104193dcfd167505ed39bcfd8ac58bb92c99e3ab1f45f134b96e0b723687da"} Jul 13 18:25:05.998364 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:05.998325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7c5dp" event={"ID":"de1eb138-9964-4ad7-bc7e-30496147abdc","Type":"ContainerStarted","Data":"6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772"} Jul 13 18:25:05.999769 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:05.999743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d87d5" event={"ID":"031863b6-0002-407e-bc22-c495541a3b54","Type":"ContainerStarted","Data":"5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521"} Jul 13 18:25:06.015601 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:06.015533 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7c5dp" podStartSLOduration=2.279442297 podStartE2EDuration="6.015516961s" totalImagesPullingTime="3.736074664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:25:06.014046101 +0000 UTC m=+457.686449925" watchObservedRunningTime="2026-07-13 18:25:06.015516961 +0000 UTC m=+457.687920785" Jul 13 18:25:06.032641 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:06.032564 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-d87d5" podStartSLOduration=1.36267393 podStartE2EDuration="5.032540297s" totalImagesPullingTime="3.669866367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:25:06.030475382 +0000 UTC m=+457.702879207" watchObservedRunningTime="2026-07-13 18:25:06.032540297 +0000 UTC m=+457.704944122" Jul 13 18:25:06.059784 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:06.059746 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7c5dp"] Jul 13 18:25:08.008861 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:08.008823 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7c5dp" podUID="de1eb138-9964-4ad7-bc7e-30496147abdc" containerName="authorino" containerID="cri-o://6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772" gracePeriod=30 Jul 13 18:25:08.259834 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:08.259765 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7c5dp" Jul 13 18:25:08.405021 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:08.404984 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wm9w\" (UniqueName: \"kubernetes.io/projected/de1eb138-9964-4ad7-bc7e-30496147abdc-kube-api-access-8wm9w\") pod \"de1eb138-9964-4ad7-bc7e-30496147abdc\" (UID: \"de1eb138-9964-4ad7-bc7e-30496147abdc\") " Jul 13 18:25:08.407065 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:08.407029 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de1eb138-9964-4ad7-bc7e-30496147abdc-kube-api-access-8wm9w" (OuterVolumeSpecName: "kube-api-access-8wm9w") pod "de1eb138-9964-4ad7-bc7e-30496147abdc" (UID: "de1eb138-9964-4ad7-bc7e-30496147abdc"). InnerVolumeSpecName "kube-api-access-8wm9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:25:08.505768 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:08.505728 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wm9w\" (UniqueName: \"kubernetes.io/projected/de1eb138-9964-4ad7-bc7e-30496147abdc-kube-api-access-8wm9w\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:25:09.014050 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.014017 2565 generic.go:356] "Generic (PLEG): container finished" podID="de1eb138-9964-4ad7-bc7e-30496147abdc" containerID="6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772" exitCode=0 Jul 13 18:25:09.014479 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.014073 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7c5dp" Jul 13 18:25:09.014479 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.014096 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7c5dp" event={"ID":"de1eb138-9964-4ad7-bc7e-30496147abdc","Type":"ContainerDied","Data":"6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772"} Jul 13 18:25:09.014479 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.014134 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7c5dp" event={"ID":"de1eb138-9964-4ad7-bc7e-30496147abdc","Type":"ContainerDied","Data":"280be565a241cc30f0ec6a18821e3115cb00a9e986d46a79998b883d906866d7"} Jul 13 18:25:09.014479 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.014151 2565 scope.go:117] "RemoveContainer" containerID="6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772" Jul 13 18:25:09.021977 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.021959 2565 scope.go:117] "RemoveContainer" containerID="6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772" Jul 13 18:25:09.022212 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:25:09.022193 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772\": container with ID starting with 6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772 not found: ID does not exist" containerID="6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772" Jul 13 18:25:09.022260 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.022220 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772"} err="failed to get container status \"6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772\": rpc error: code = NotFound desc = could not find container \"6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772\": container with ID starting with 6b8bc19b84bd582a4c61cffea38efea27294444dc84331dfe9a143290fcdd772 not found: ID does not exist" Jul 13 18:25:09.050516 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.050483 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7c5dp"] Jul 13 18:25:09.061888 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:09.061865 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7c5dp"] Jul 13 18:25:10.992502 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:10.992469 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de1eb138-9964-4ad7-bc7e-30496147abdc" path="/var/lib/kubelet/pods/de1eb138-9964-4ad7-bc7e-30496147abdc/volumes" Jul 13 18:25:21.163409 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:21.163364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:21.257089 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:21.257052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:21.724825 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:21.724786 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:33.528092 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.528056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:33.777678 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.777641 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qgbsx"] Jul 13 18:25:33.777978 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.777966 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de1eb138-9964-4ad7-bc7e-30496147abdc" containerName="authorino" Jul 13 18:25:33.778022 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.777979 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="de1eb138-9964-4ad7-bc7e-30496147abdc" containerName="authorino" Jul 13 18:25:33.778056 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.778042 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="de1eb138-9964-4ad7-bc7e-30496147abdc" containerName="authorino" Jul 13 18:25:33.781449 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.781434 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" Jul 13 18:25:33.794456 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.794432 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qgbsx"] Jul 13 18:25:33.817720 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.817695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cbv\" (UniqueName: \"kubernetes.io/projected/68db5007-2ce1-4db2-8800-03ce3516ecdd-kube-api-access-h4cbv\") pod \"authorino-5d4b67c446-qgbsx\" (UID: \"68db5007-2ce1-4db2-8800-03ce3516ecdd\") " pod="kuadrant-system/authorino-5d4b67c446-qgbsx" Jul 13 18:25:33.895226 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.895171 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:33.918521 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.918493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cbv\" (UniqueName: \"kubernetes.io/projected/68db5007-2ce1-4db2-8800-03ce3516ecdd-kube-api-access-h4cbv\") pod \"authorino-5d4b67c446-qgbsx\" (UID: \"68db5007-2ce1-4db2-8800-03ce3516ecdd\") " pod="kuadrant-system/authorino-5d4b67c446-qgbsx" Jul 13 18:25:33.926989 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:33.926957 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cbv\" (UniqueName: \"kubernetes.io/projected/68db5007-2ce1-4db2-8800-03ce3516ecdd-kube-api-access-h4cbv\") pod \"authorino-5d4b67c446-qgbsx\" (UID: \"68db5007-2ce1-4db2-8800-03ce3516ecdd\") " pod="kuadrant-system/authorino-5d4b67c446-qgbsx" Jul 13 18:25:34.033699 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:34.033607 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qgbsx"] Jul 13 18:25:34.033908 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:34.033891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" Jul 13 18:25:34.173487 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:34.173393 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qgbsx"] Jul 13 18:25:34.176040 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:25:34.176008 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68db5007_2ce1_4db2_8800_03ce3516ecdd.slice/crio-0aae2b2ddb88f1a12463a8d654ac24c7a5ad9c9de38e63eb4e870ba0d0002a43 WatchSource:0}: Error finding container 0aae2b2ddb88f1a12463a8d654ac24c7a5ad9c9de38e63eb4e870ba0d0002a43: Status 404 returned error can't find the container with id 0aae2b2ddb88f1a12463a8d654ac24c7a5ad9c9de38e63eb4e870ba0d0002a43 Jul 13 18:25:35.133691 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.133655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" event={"ID":"68db5007-2ce1-4db2-8800-03ce3516ecdd","Type":"ContainerStarted","Data":"9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a"} Jul 13 18:25:35.133691 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.133691 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" event={"ID":"68db5007-2ce1-4db2-8800-03ce3516ecdd","Type":"ContainerStarted","Data":"0aae2b2ddb88f1a12463a8d654ac24c7a5ad9c9de38e63eb4e870ba0d0002a43"} Jul 13 18:25:35.134189 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.133706 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" podUID="68db5007-2ce1-4db2-8800-03ce3516ecdd" containerName="authorino" containerID="cri-o://9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a" gracePeriod=30 Jul 13 18:25:35.153306 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.153244 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" podStartSLOduration=1.5780535100000002 podStartE2EDuration="2.153227806s" totalImagesPullingTime="575.174296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:25:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:25:35.152482661 +0000 UTC m=+486.824886484" watchObservedRunningTime="2026-07-13 18:25:35.153227806 +0000 UTC m=+486.825631628" Jul 13 18:25:35.377125 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.377102 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" Jul 13 18:25:35.431635 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.431533 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4cbv\" (UniqueName: \"kubernetes.io/projected/68db5007-2ce1-4db2-8800-03ce3516ecdd-kube-api-access-h4cbv\") pod \"68db5007-2ce1-4db2-8800-03ce3516ecdd\" (UID: \"68db5007-2ce1-4db2-8800-03ce3516ecdd\") " Jul 13 18:25:35.433473 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.433452 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68db5007-2ce1-4db2-8800-03ce3516ecdd-kube-api-access-h4cbv" (OuterVolumeSpecName: "kube-api-access-h4cbv") pod "68db5007-2ce1-4db2-8800-03ce3516ecdd" (UID: "68db5007-2ce1-4db2-8800-03ce3516ecdd"). InnerVolumeSpecName "kube-api-access-h4cbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:25:35.532930 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:35.532894 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4cbv\" (UniqueName: \"kubernetes.io/projected/68db5007-2ce1-4db2-8800-03ce3516ecdd-kube-api-access-h4cbv\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:25:36.139629 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.139596 2565 generic.go:356] "Generic (PLEG): container finished" podID="68db5007-2ce1-4db2-8800-03ce3516ecdd" containerID="9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a" exitCode=0 Jul 13 18:25:36.140032 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.139636 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" Jul 13 18:25:36.140032 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.139656 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" event={"ID":"68db5007-2ce1-4db2-8800-03ce3516ecdd","Type":"ContainerDied","Data":"9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a"} Jul 13 18:25:36.140032 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.139686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-qgbsx" event={"ID":"68db5007-2ce1-4db2-8800-03ce3516ecdd","Type":"ContainerDied","Data":"0aae2b2ddb88f1a12463a8d654ac24c7a5ad9c9de38e63eb4e870ba0d0002a43"} Jul 13 18:25:36.140032 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.139705 2565 scope.go:117] "RemoveContainer" containerID="9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a" Jul 13 18:25:36.148091 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.148065 2565 scope.go:117] "RemoveContainer" containerID="9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a" Jul 13 18:25:36.148388 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:25:36.148362 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a\": container with ID starting with 9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a not found: ID does not exist" containerID="9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a" Jul 13 18:25:36.148453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.148399 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a"} err="failed to get container status \"9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a\": rpc error: code = NotFound desc = could not find container \"9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a\": container with ID starting with 9c77f2b0756933708a17c18cda1c1bd2ae197b1c82441f7c036ecf6d5a57075a not found: ID does not exist" Jul 13 18:25:36.166300 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.166276 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qgbsx"] Jul 13 18:25:36.171182 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.171161 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-qgbsx"] Jul 13 18:25:36.995506 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:36.995473 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68db5007-2ce1-4db2-8800-03ce3516ecdd" path="/var/lib/kubelet/pods/68db5007-2ce1-4db2-8800-03ce3516ecdd/volumes" Jul 13 18:25:39.290900 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:39.290867 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d87d5"] Jul 13 18:25:39.291365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:39.291163 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-d87d5" podUID="031863b6-0002-407e-bc22-c495541a3b54" containerName="authorino" containerID="cri-o://5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521" gracePeriod=30 Jul 13 18:25:39.540057 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:39.540032 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d87d5" Jul 13 18:25:39.669131 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:39.669050 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-727tb\" (UniqueName: \"kubernetes.io/projected/031863b6-0002-407e-bc22-c495541a3b54-kube-api-access-727tb\") pod \"031863b6-0002-407e-bc22-c495541a3b54\" (UID: \"031863b6-0002-407e-bc22-c495541a3b54\") " Jul 13 18:25:39.671117 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:39.671077 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/031863b6-0002-407e-bc22-c495541a3b54-kube-api-access-727tb" (OuterVolumeSpecName: "kube-api-access-727tb") pod "031863b6-0002-407e-bc22-c495541a3b54" (UID: "031863b6-0002-407e-bc22-c495541a3b54"). InnerVolumeSpecName "kube-api-access-727tb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:25:39.770066 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:39.770035 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-727tb\" (UniqueName: \"kubernetes.io/projected/031863b6-0002-407e-bc22-c495541a3b54-kube-api-access-727tb\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:25:40.159905 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.159870 2565 generic.go:356] "Generic (PLEG): container finished" podID="031863b6-0002-407e-bc22-c495541a3b54" containerID="5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521" exitCode=0 Jul 13 18:25:40.159905 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.159908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d87d5" event={"ID":"031863b6-0002-407e-bc22-c495541a3b54","Type":"ContainerDied","Data":"5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521"} Jul 13 18:25:40.160258 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.159935 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d87d5" event={"ID":"031863b6-0002-407e-bc22-c495541a3b54","Type":"ContainerDied","Data":"75104193dcfd167505ed39bcfd8ac58bb92c99e3ab1f45f134b96e0b723687da"} Jul 13 18:25:40.160258 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.159909 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d87d5" Jul 13 18:25:40.160258 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.159950 2565 scope.go:117] "RemoveContainer" containerID="5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521" Jul 13 18:25:40.168388 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.168370 2565 scope.go:117] "RemoveContainer" containerID="5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521" Jul 13 18:25:40.168683 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:25:40.168660 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521\": container with ID starting with 5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521 not found: ID does not exist" containerID="5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521" Jul 13 18:25:40.168758 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.168691 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521"} err="failed to get container status \"5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521\": rpc error: code = NotFound desc = could not find container \"5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521\": container with ID starting with 5e2e962f293fe78052eeacd21f2eca374dddc017820e027f2a89aff8d197c521 not found: ID does not exist" Jul 13 18:25:40.181446 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.181422 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d87d5"] Jul 13 18:25:40.185106 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.185086 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d87d5"] Jul 13 18:25:40.993074 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:40.993043 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="031863b6-0002-407e-bc22-c495541a3b54" path="/var/lib/kubelet/pods/031863b6-0002-407e-bc22-c495541a3b54/volumes" Jul 13 18:25:44.122206 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.122170 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-776c988fdd-4h6dx"] Jul 13 18:25:44.122692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.122657 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="031863b6-0002-407e-bc22-c495541a3b54" containerName="authorino" Jul 13 18:25:44.122692 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.122675 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="031863b6-0002-407e-bc22-c495541a3b54" containerName="authorino" Jul 13 18:25:44.122804 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.122712 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68db5007-2ce1-4db2-8800-03ce3516ecdd" containerName="authorino" Jul 13 18:25:44.122804 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.122720 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="68db5007-2ce1-4db2-8800-03ce3516ecdd" containerName="authorino" Jul 13 18:25:44.122898 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.122831 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="031863b6-0002-407e-bc22-c495541a3b54" containerName="authorino" Jul 13 18:25:44.122898 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.122848 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="68db5007-2ce1-4db2-8800-03ce3516ecdd" containerName="authorino" Jul 13 18:25:44.125069 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.125025 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:44.125986 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.125968 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.128406 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.128388 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 13 18:25:44.128654 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.128636 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 13 18:25:44.129132 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.129118 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fth5s\"" Jul 13 18:25:44.142956 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.142933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-776c988fdd-4h6dx"] Jul 13 18:25:44.210750 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.210719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h2gf\" (UniqueName: \"kubernetes.io/projected/0e798f03-aec8-4ab6-b66f-1fc55165cf72-kube-api-access-6h2gf\") pod \"maas-controller-776c988fdd-4h6dx\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.210930 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.210775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e798f03-aec8-4ab6-b66f-1fc55165cf72-webhook-cert\") pod \"maas-controller-776c988fdd-4h6dx\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.311927 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.311891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h2gf\" (UniqueName: \"kubernetes.io/projected/0e798f03-aec8-4ab6-b66f-1fc55165cf72-kube-api-access-6h2gf\") pod \"maas-controller-776c988fdd-4h6dx\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.312143 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.311941 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e798f03-aec8-4ab6-b66f-1fc55165cf72-webhook-cert\") pod \"maas-controller-776c988fdd-4h6dx\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.314486 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.314461 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e798f03-aec8-4ab6-b66f-1fc55165cf72-webhook-cert\") pod \"maas-controller-776c988fdd-4h6dx\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.324618 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.324594 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h2gf\" (UniqueName: \"kubernetes.io/projected/0e798f03-aec8-4ab6-b66f-1fc55165cf72-kube-api-access-6h2gf\") pod \"maas-controller-776c988fdd-4h6dx\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.358220 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.358184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:44.436176 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.436082 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:44.456548 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.456505 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:44.570652 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:44.570623 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-776c988fdd-4h6dx"] Jul 13 18:25:44.573240 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:25:44.573213 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e798f03_aec8_4ab6_b66f_1fc55165cf72.slice/crio-7241a52066707485d51a53f5da1350254601956d9e60d3dca1cc6668cbb04ae9 WatchSource:0}: Error finding container 7241a52066707485d51a53f5da1350254601956d9e60d3dca1cc6668cbb04ae9: Status 404 returned error can't find the container with id 7241a52066707485d51a53f5da1350254601956d9e60d3dca1cc6668cbb04ae9 Jul 13 18:25:45.183255 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:45.183222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776c988fdd-4h6dx" event={"ID":"0e798f03-aec8-4ab6-b66f-1fc55165cf72","Type":"ContainerStarted","Data":"7241a52066707485d51a53f5da1350254601956d9e60d3dca1cc6668cbb04ae9"} Jul 13 18:25:47.382957 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:47.382854 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:47.554266 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:47.554233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:25:48.199660 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:48.199620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776c988fdd-4h6dx" event={"ID":"0e798f03-aec8-4ab6-b66f-1fc55165cf72","Type":"ContainerStarted","Data":"293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5"} Jul 13 18:25:48.199862 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:48.199686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:48.222872 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:48.222824 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-776c988fdd-4h6dx" podStartSLOduration=1.664342319 podStartE2EDuration="4.222810579s" totalImagesPullingTime="2.55846826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:25:48.221250361 +0000 UTC m=+499.893654185" watchObservedRunningTime="2026-07-13 18:25:48.222810579 +0000 UTC m=+499.895214401" Jul 13 18:25:58.327979 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.327944 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-776c988fdd-4h6dx"] Jul 13 18:25:58.328496 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.328138 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-776c988fdd-4h6dx" podUID="0e798f03-aec8-4ab6-b66f-1fc55165cf72" containerName="manager" containerID="cri-o://293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5" gracePeriod=30 Jul 13 18:25:58.329845 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.329820 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:58.567967 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.567945 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:58.742327 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.742238 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h2gf\" (UniqueName: \"kubernetes.io/projected/0e798f03-aec8-4ab6-b66f-1fc55165cf72-kube-api-access-6h2gf\") pod \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " Jul 13 18:25:58.742327 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.742284 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e798f03-aec8-4ab6-b66f-1fc55165cf72-webhook-cert\") pod \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\" (UID: \"0e798f03-aec8-4ab6-b66f-1fc55165cf72\") " Jul 13 18:25:58.744473 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.744444 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e798f03-aec8-4ab6-b66f-1fc55165cf72-kube-api-access-6h2gf" (OuterVolumeSpecName: "kube-api-access-6h2gf") pod "0e798f03-aec8-4ab6-b66f-1fc55165cf72" (UID: "0e798f03-aec8-4ab6-b66f-1fc55165cf72"). InnerVolumeSpecName "kube-api-access-6h2gf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 18:25:58.744576 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.744464 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e798f03-aec8-4ab6-b66f-1fc55165cf72-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0e798f03-aec8-4ab6-b66f-1fc55165cf72" (UID: "0e798f03-aec8-4ab6-b66f-1fc55165cf72"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 18:25:58.843085 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.843046 2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0e798f03-aec8-4ab6-b66f-1fc55165cf72-webhook-cert\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:25:58.843085 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:58.843080 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h2gf\" (UniqueName: \"kubernetes.io/projected/0e798f03-aec8-4ab6-b66f-1fc55165cf72-kube-api-access-6h2gf\") on node \"ip-10-0-133-129.ec2.internal\" DevicePath \"\"" Jul 13 18:25:59.248609 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.248553 2565 generic.go:356] "Generic (PLEG): container finished" podID="0e798f03-aec8-4ab6-b66f-1fc55165cf72" containerID="293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5" exitCode=0 Jul 13 18:25:59.248609 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.248606 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-776c988fdd-4h6dx" Jul 13 18:25:59.248905 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.248621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776c988fdd-4h6dx" event={"ID":"0e798f03-aec8-4ab6-b66f-1fc55165cf72","Type":"ContainerDied","Data":"293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5"} Jul 13 18:25:59.248905 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.248683 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-776c988fdd-4h6dx" event={"ID":"0e798f03-aec8-4ab6-b66f-1fc55165cf72","Type":"ContainerDied","Data":"7241a52066707485d51a53f5da1350254601956d9e60d3dca1cc6668cbb04ae9"} Jul 13 18:25:59.248905 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.248713 2565 scope.go:117] "RemoveContainer" containerID="293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5" Jul 13 18:25:59.257085 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.257064 2565 scope.go:117] "RemoveContainer" containerID="293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5" Jul 13 18:25:59.257405 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:25:59.257382 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5\": container with ID starting with 293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5 not found: ID does not exist" containerID="293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5" Jul 13 18:25:59.257484 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.257418 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5"} err="failed to get container status \"293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5\": rpc error: code = NotFound desc = could not find container \"293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5\": container with ID starting with 293e7476783a37646fc640fe5e73aa4c944cf14916ca7706ad508f23b7a7dff5 not found: ID does not exist" Jul 13 18:25:59.268046 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.268020 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-776c988fdd-4h6dx"] Jul 13 18:25:59.275597 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:25:59.275558 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-776c988fdd-4h6dx"] Jul 13 18:26:00.992530 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:00.992499 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e798f03-aec8-4ab6-b66f-1fc55165cf72" path="/var/lib/kubelet/pods/0e798f03-aec8-4ab6-b66f-1fc55165cf72/volumes" Jul 13 18:26:18.876757 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:18.876716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:18.990130 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:18.990096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:19.444602 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.444507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:19.507166 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.507065 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5"] Jul 13 18:26:19.507512 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.507495 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e798f03-aec8-4ab6-b66f-1fc55165cf72" containerName="manager" Jul 13 18:26:19.507629 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.507514 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e798f03-aec8-4ab6-b66f-1fc55165cf72" containerName="manager" Jul 13 18:26:19.507629 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.507604 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e798f03-aec8-4ab6-b66f-1fc55165cf72" containerName="manager" Jul 13 18:26:19.510754 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.510733 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.513555 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.513537 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 13 18:26:19.513807 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.513792 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 13 18:26:19.515456 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.515442 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 13 18:26:19.516437 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.516419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9286c882-0a28-46f6-a804-e5b7e5040f2f-openshift-service-ca\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.516516 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.516450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwcxh\" (UniqueName: \"kubernetes.io/projected/9286c882-0a28-46f6-a804-e5b7e5040f2f-kube-api-access-cwcxh\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.516516 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.516485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9286c882-0a28-46f6-a804-e5b7e5040f2f-maas-api-tls\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.532637 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.532612 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5"] Jul 13 18:26:19.617045 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.617012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9286c882-0a28-46f6-a804-e5b7e5040f2f-openshift-service-ca\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.617045 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.617051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwcxh\" (UniqueName: \"kubernetes.io/projected/9286c882-0a28-46f6-a804-e5b7e5040f2f-kube-api-access-cwcxh\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.617272 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.617088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9286c882-0a28-46f6-a804-e5b7e5040f2f-maas-api-tls\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.617272 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:26:19.617187 2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 13 18:26:19.617350 ip-10-0-133-129 kubenswrapper[2565]: E0713 18:26:19.617277 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286c882-0a28-46f6-a804-e5b7e5040f2f-maas-api-tls podName:9286c882-0a28-46f6-a804-e5b7e5040f2f nodeName:}" failed. No retries permitted until 2026-07-13 18:26:20.117256507 +0000 UTC m=+531.789660308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9286c882-0a28-46f6-a804-e5b7e5040f2f-maas-api-tls") pod "maas-api-79bd5ff7d7-5vzs5" (UID: "9286c882-0a28-46f6-a804-e5b7e5040f2f") : secret "maas-api-serving-cert" not found Jul 13 18:26:19.617662 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.617645 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9286c882-0a28-46f6-a804-e5b7e5040f2f-openshift-service-ca\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.632197 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.632172 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwcxh\" (UniqueName: \"kubernetes.io/projected/9286c882-0a28-46f6-a804-e5b7e5040f2f-kube-api-access-cwcxh\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:19.745776 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:19.745692 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:20.037592 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.037557 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:20.121365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.121336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9286c882-0a28-46f6-a804-e5b7e5040f2f-maas-api-tls\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:20.123725 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.123700 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9286c882-0a28-46f6-a804-e5b7e5040f2f-maas-api-tls\") pod \"maas-api-79bd5ff7d7-5vzs5\" (UID: \"9286c882-0a28-46f6-a804-e5b7e5040f2f\") " pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:20.128656 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.128630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:20.155574 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.155546 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-db5sc"] Jul 13 18:26:20.163306 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.163281 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.174691 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.174436 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-bwgxw\"" Jul 13 18:26:20.174691 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.174562 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 18:26:20.177612 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.177566 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-db5sc"] Jul 13 18:26:20.222031 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.221990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krmh8\" (UniqueName: \"kubernetes.io/projected/882fb806-4b11-4153-aff1-2f550ec28819-kube-api-access-krmh8\") pod \"payload-processing-f9b8d9b9b-db5sc\" (UID: \"882fb806-4b11-4153-aff1-2f550ec28819\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.222211 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.222052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/882fb806-4b11-4153-aff1-2f550ec28819-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-db5sc\" (UID: \"882fb806-4b11-4153-aff1-2f550ec28819\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.323185 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.323106 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/882fb806-4b11-4153-aff1-2f550ec28819-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-db5sc\" (UID: \"882fb806-4b11-4153-aff1-2f550ec28819\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.323185 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.323182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krmh8\" (UniqueName: \"kubernetes.io/projected/882fb806-4b11-4153-aff1-2f550ec28819-kube-api-access-krmh8\") pod \"payload-processing-f9b8d9b9b-db5sc\" (UID: \"882fb806-4b11-4153-aff1-2f550ec28819\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.323835 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.323808 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/882fb806-4b11-4153-aff1-2f550ec28819-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-db5sc\" (UID: \"882fb806-4b11-4153-aff1-2f550ec28819\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.335297 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.335268 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krmh8\" (UniqueName: \"kubernetes.io/projected/882fb806-4b11-4153-aff1-2f550ec28819-kube-api-access-krmh8\") pod \"payload-processing-f9b8d9b9b-db5sc\" (UID: \"882fb806-4b11-4153-aff1-2f550ec28819\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.421187 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.421154 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:20.484977 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.484946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:20.568837 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.568810 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5"] Jul 13 18:26:20.571680 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:26:20.571641 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9286c882_0a28_46f6_a804_e5b7e5040f2f.slice/crio-426f9db20d783a9a79fd9d8dea0c3275bfa0ef630564c76d882b9132488ced45 WatchSource:0}: Error finding container 426f9db20d783a9a79fd9d8dea0c3275bfa0ef630564c76d882b9132488ced45: Status 404 returned error can't find the container with id 426f9db20d783a9a79fd9d8dea0c3275bfa0ef630564c76d882b9132488ced45 Jul 13 18:26:20.635267 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:20.635237 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-db5sc"] Jul 13 18:26:20.638216 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:26:20.638190 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882fb806_4b11_4153_aff1_2f550ec28819.slice/crio-82486595bd661b2725d57e560cd859cfbd7474173b08b99efc60526ed7889fc2 WatchSource:0}: Error finding container 82486595bd661b2725d57e560cd859cfbd7474173b08b99efc60526ed7889fc2: Status 404 returned error can't find the container with id 82486595bd661b2725d57e560cd859cfbd7474173b08b99efc60526ed7889fc2 Jul 13 18:26:21.355068 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:21.355029 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" event={"ID":"9286c882-0a28-46f6-a804-e5b7e5040f2f","Type":"ContainerStarted","Data":"426f9db20d783a9a79fd9d8dea0c3275bfa0ef630564c76d882b9132488ced45"} Jul 13 18:26:21.356193 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:21.356166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" event={"ID":"882fb806-4b11-4153-aff1-2f550ec28819","Type":"ContainerStarted","Data":"82486595bd661b2725d57e560cd859cfbd7474173b08b99efc60526ed7889fc2"} Jul 13 18:26:23.368412 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:23.368371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" event={"ID":"882fb806-4b11-4153-aff1-2f550ec28819","Type":"ContainerStarted","Data":"400a231b0ee4756654a5e3a96faa06d193135025c3e4701d067ffd2952de1872"} Jul 13 18:26:23.368858 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:23.368438 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:23.369773 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:23.369745 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" event={"ID":"9286c882-0a28-46f6-a804-e5b7e5040f2f","Type":"ContainerStarted","Data":"2789c512fcc54ce5577af1ea0a7cef841ab1ad9cc9e8cfa66cfc17ceddded27f"} Jul 13 18:26:23.369886 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:23.369851 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:23.386556 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:23.386506 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" podStartSLOduration=1.455948429 podStartE2EDuration="3.386490061s" totalImagesPullingTime="1.930541632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:26:23.385717865 +0000 UTC m=+535.058121688" watchObservedRunningTime="2026-07-13 18:26:23.386490061 +0000 UTC m=+535.058893884" Jul 13 18:26:23.408664 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:23.408613 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" podStartSLOduration=2.408713134 podStartE2EDuration="4.408577424s" totalImagesPullingTime="1.99986429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:26:23.406410441 +0000 UTC m=+535.078814267" watchObservedRunningTime="2026-07-13 18:26:23.408577424 +0000 UTC m=+535.080981252" Jul 13 18:26:29.380604 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:29.380549 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79bd5ff7d7-5vzs5" Jul 13 18:26:30.420101 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:30.420058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:30.528482 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:30.528438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:34.380903 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:34.380874 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-db5sc" Jul 13 18:26:34.413148 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:34.413116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:41.182300 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.182267 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s"] Jul 13 18:26:41.186858 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.186842 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.189481 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.189454 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-thlvn\"" Jul 13 18:26:41.191145 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.191125 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 18:26:41.191253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.191184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 13 18:26:41.191253 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.191206 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 18:26:41.198098 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.198077 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s"] Jul 13 18:26:41.203128 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.203103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:26:41.297555 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.297524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.297555 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.297561 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.297811 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.297605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gktjp\" (UniqueName: \"kubernetes.io/projected/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-kube-api-access-gktjp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.297811 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.297687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.297811 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.297723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.297811 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.297777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.398595 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.398552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gktjp\" (UniqueName: \"kubernetes.io/projected/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-kube-api-access-gktjp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.398782 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.398604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.398782 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.398628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.398782 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.398673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.398782 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.398695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.398782 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.398720 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.399132 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.399107 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.399202 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.399123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.399202 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.399160 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.401045 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.401022 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.401162 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.401148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.407422 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.407402 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gktjp\" (UniqueName: \"kubernetes.io/projected/d20e24a3-4f0c-4218-af4c-218c4f50fcf0-kube-api-access-gktjp\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s\" (UID: \"d20e24a3-4f0c-4218-af4c-218c4f50fcf0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.496730 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.496648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:41.636819 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:41.636790 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s"] Jul 13 18:26:41.639333 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:26:41.639304 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd20e24a3_4f0c_4218_af4c_218c4f50fcf0.slice/crio-2013b13a528c4d6156e29ed4ecfc54e26789cf3bf13d07ad8477662e16548d06 WatchSource:0}: Error finding container 2013b13a528c4d6156e29ed4ecfc54e26789cf3bf13d07ad8477662e16548d06: Status 404 returned error can't find the container with id 2013b13a528c4d6156e29ed4ecfc54e26789cf3bf13d07ad8477662e16548d06 Jul 13 18:26:42.456533 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:42.456496 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" event={"ID":"d20e24a3-4f0c-4218-af4c-218c4f50fcf0","Type":"ContainerStarted","Data":"2013b13a528c4d6156e29ed4ecfc54e26789cf3bf13d07ad8477662e16548d06"} Jul 13 18:26:43.463069 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:43.463036 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" event={"ID":"d20e24a3-4f0c-4218-af4c-218c4f50fcf0","Type":"ContainerStarted","Data":"fc50c5a978608725884a627623204135680f3607a937b84cb163c81e153053c8"} Jul 13 18:26:43.485225 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:43.485154 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" podStartSLOduration=1.334138544 podStartE2EDuration="2.485134715s" totalImagesPullingTime="1.150996171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:26:43.483491036 +0000 UTC m=+555.155894860" watchObservedRunningTime="2026-07-13 18:26:43.485134715 +0000 UTC m=+555.157538540" Jul 13 18:26:51.496802 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:51.496760 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:51.497365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:51.496833 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:51.509416 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:51.509394 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:52.515041 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:52.515011 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s" Jul 13 18:26:56.925079 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:26:56.925051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:27:21.420231 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:27:21.420193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:27:28.811470 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:27:28.811438 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:27:28.812012 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:27:28.811861 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k7qtp_5cd34880-0897-4dab-ad46-d66549cb2d8a/ovn-acl-logging/0.log" Jul 13 18:27:29.306623 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:27:29.306549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:27:35.193769 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:27:35.193733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:27:41.841070 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:27:41.841018 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:17.360193 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:17.360159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:34.344812 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.344774 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d6b898f4f-gc97r"] Jul 13 18:28:34.347365 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.347344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.352106 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.352078 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 18:28:34.352245 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.352121 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bvf57\"" Jul 13 18:28:34.358621 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.358597 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d6b898f4f-gc97r"] Jul 13 18:28:34.486042 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.486001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0-tls-cert\") pod \"authorino-6d6b898f4f-gc97r\" (UID: \"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0\") " pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.486214 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.486080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltgkw\" (UniqueName: \"kubernetes.io/projected/f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0-kube-api-access-ltgkw\") pod \"authorino-6d6b898f4f-gc97r\" (UID: \"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0\") " pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.587373 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.587333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0-tls-cert\") pod \"authorino-6d6b898f4f-gc97r\" (UID: \"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0\") " pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.587557 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.587431 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltgkw\" (UniqueName: \"kubernetes.io/projected/f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0-kube-api-access-ltgkw\") pod \"authorino-6d6b898f4f-gc97r\" (UID: \"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0\") " pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.589966 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.589927 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0-tls-cert\") pod \"authorino-6d6b898f4f-gc97r\" (UID: \"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0\") " pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.597274 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.597214 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltgkw\" (UniqueName: \"kubernetes.io/projected/f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0-kube-api-access-ltgkw\") pod \"authorino-6d6b898f4f-gc97r\" (UID: \"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0\") " pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.656842 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.656813 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d6b898f4f-gc97r" Jul 13 18:28:34.699205 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.699166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:34.782817 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.782779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:34.802240 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.802091 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d6b898f4f-gc97r"] Jul 13 18:28:34.804482 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:28:34.804447 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3eceeb2_0c84_48b2_a6d2_d2d9af34dfc0.slice/crio-460a1b300cfbd39387b953275e4eca0480e565570508c682cbbf35e1b99aa12f WatchSource:0}: Error finding container 460a1b300cfbd39387b953275e4eca0480e565570508c682cbbf35e1b99aa12f: Status 404 returned error can't find the container with id 460a1b300cfbd39387b953275e4eca0480e565570508c682cbbf35e1b99aa12f Jul 13 18:28:34.967349 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:34.967258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d6b898f4f-gc97r" event={"ID":"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0","Type":"ContainerStarted","Data":"460a1b300cfbd39387b953275e4eca0480e565570508c682cbbf35e1b99aa12f"} Jul 13 18:28:35.875438 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:35.875402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:35.973599 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:35.973543 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d6b898f4f-gc97r" event={"ID":"f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0","Type":"ContainerStarted","Data":"5d20ba96532017375bad19063ddcadb1a71ea2d54e01f02e26184348f7ecfe11"} Jul 13 18:28:35.977094 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:35.977048 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:35.997702 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:35.997649 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d6b898f4f-gc97r" podStartSLOduration=1.4849070420000001 podStartE2EDuration="1.997626589s" totalImagesPullingTime="512.719547ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 18:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:28:35.997184688 +0000 UTC m=+667.669588514" watchObservedRunningTime="2026-07-13 18:28:35.997626589 +0000 UTC m=+667.670030412" Jul 13 18:28:50.470696 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:50.470662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:52.885182 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:52.885152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:28:52.980703 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:28:52.980672 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:29:19.790296 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:19.790219 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d6b898f4f-gc97r_f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0/authorino/0.log" Jul 13 18:29:25.450001 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:25.449972 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lrj54_2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48/server/0.log" Jul 13 18:29:25.986965 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:25.986932 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db786db4b-z54rx_b63c570a-c8d2-4240-a792-cd49b6fe375e/copy-manifests/0.log" Jul 13 18:29:25.994336 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:25.994303 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db786db4b-z54rx_b63c570a-c8d2-4240-a792-cd49b6fe375e/manager/0.log" Jul 13 18:29:26.365835 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:26.365809 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79bd5ff7d7-5vzs5_9286c882-0a28-46f6-a804-e5b7e5040f2f/maas-api/0.log" Jul 13 18:29:27.954294 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:27.954265 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d6b898f4f-gc97r_f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0/authorino/0.log" Jul 13 18:29:28.214219 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:28.214146 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2tmvb_3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe/manager/0.log" Jul 13 18:29:28.338407 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:28.338383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rg8l5_9c64a13f-c509-48f8-86cc-d1d06348860a/kuadrant-console-plugin/0.log" Jul 13 18:29:28.597718 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:28.597688 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-884gh_c0ab018b-579b-49b2-9805-29a7831c9bce/manager/0.log" Jul 13 18:29:29.525018 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:29.524991 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bfdc649b5-n5htj_fd306fa5-4b2c-436a-933c-9087dce172d8/kube-auth-proxy/0.log" Jul 13 18:29:30.023341 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:30.023315 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-db5sc_882fb806-4b11-4153-aff1-2f550ec28819/payload-processing/0.log" Jul 13 18:29:30.529796 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:30.529769 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-svs5s_d20e24a3-4f0c-4218-af4c-218c4f50fcf0/main/0.log" Jul 13 18:29:35.998403 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:35.998364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:29:36.098485 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:36.098443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:29:39.578282 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:39.578243 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mjq45_fc9c4cfd-d45c-4e0d-86df-0cb6cb9c1d9f/global-pull-secret-syncer/0.log" Jul 13 18:29:39.633084 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:39.633048 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" Jul 13 18:29:39.743028 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:39.742987 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-129.ec2.internal_9f7ba1521bdac6f9a0678ebd5382c9d2/haproxy/0.log" Jul 13 18:29:44.071630 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:44.071570 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6d6b898f4f-gc97r_f3eceeb2-0c84-48b2-a6d2-d2d9af34dfc0/authorino/0.log" Jul 13 18:29:44.152936 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:44.152906 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2tmvb_3c1bc2fb-c62a-4a61-b04c-7c287b9eedfe/manager/0.log" Jul 13 18:29:44.196032 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:44.195999 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rg8l5_9c64a13f-c509-48f8-86cc-d1d06348860a/kuadrant-console-plugin/0.log" Jul 13 18:29:44.275187 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:44.275113 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-884gh_c0ab018b-579b-49b2-9805-29a7831c9bce/manager/0.log" Jul 13 18:29:46.221701 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.221669 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5b8xh_db72ebb3-be1c-4513-bf71-dc281161b84e/kube-state-metrics/0.log" Jul 13 18:29:46.253850 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.253822 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5b8xh_db72ebb3-be1c-4513-bf71-dc281161b84e/kube-rbac-proxy-main/0.log" Jul 13 18:29:46.281818 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.281795 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-5b8xh_db72ebb3-be1c-4513-bf71-dc281161b84e/kube-rbac-proxy-self/0.log" Jul 13 18:29:46.354560 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.354537 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-99bjp_249f6c38-23c4-4349-91ad-374c4659b774/monitoring-plugin/0.log" Jul 13 18:29:46.612479 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.612458 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v42wl_3a7dacb9-b578-4e00-b3c3-fdc2fd059250/node-exporter/0.log" Jul 13 18:29:46.640693 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.640675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v42wl_3a7dacb9-b578-4e00-b3c3-fdc2fd059250/kube-rbac-proxy/0.log" Jul 13 18:29:46.668729 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.668707 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v42wl_3a7dacb9-b578-4e00-b3c3-fdc2fd059250/init-textfile/0.log" Jul 13 18:29:46.817594 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.817513 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d86ae42-5178-4d98-8ebb-985c8904eca6/prometheus/0.log" Jul 13 18:29:46.838643 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.838622 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d86ae42-5178-4d98-8ebb-985c8904eca6/config-reloader/0.log" Jul 13 18:29:46.865566 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.865542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d86ae42-5178-4d98-8ebb-985c8904eca6/thanos-sidecar/0.log" Jul 13 18:29:46.889704 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.889682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d86ae42-5178-4d98-8ebb-985c8904eca6/kube-rbac-proxy-web/0.log" Jul 13 18:29:46.917919 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.917896 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d86ae42-5178-4d98-8ebb-985c8904eca6/kube-rbac-proxy/0.log" Jul 13 18:29:46.948832 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.948801 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d86ae42-5178-4d98-8ebb-985c8904eca6/kube-rbac-proxy-thanos/0.log" Jul 13 18:29:46.973477 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:46.973448 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1d86ae42-5178-4d98-8ebb-985c8904eca6/init-config-reloader/0.log" Jul 13 18:29:47.035522 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.035497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4jq5n_3157ec82-1ebe-4daf-9f0c-225a70239f18/prometheus-operator/0.log" Jul 13 18:29:47.100986 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.100910 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4jq5n_3157ec82-1ebe-4daf-9f0c-225a70239f18/kube-rbac-proxy/0.log" Jul 13 18:29:47.136808 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.136784 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-8jlgz_2a10e4ef-ef2d-4c3e-b506-bb3a06b310e4/prometheus-operator-admission-webhook/0.log" Jul 13 18:29:47.343149 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.343121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54967b65dd-qmqdh_4b7b14f3-829f-4d57-b0a2-31c27b8453cd/thanos-query/0.log" Jul 13 18:29:47.379770 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.379699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54967b65dd-qmqdh_4b7b14f3-829f-4d57-b0a2-31c27b8453cd/kube-rbac-proxy-web/0.log" Jul 13 18:29:47.406363 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.406338 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54967b65dd-qmqdh_4b7b14f3-829f-4d57-b0a2-31c27b8453cd/kube-rbac-proxy/0.log" Jul 13 18:29:47.432883 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.432859 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54967b65dd-qmqdh_4b7b14f3-829f-4d57-b0a2-31c27b8453cd/prom-label-proxy/0.log" Jul 13 18:29:47.456790 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.456767 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54967b65dd-qmqdh_4b7b14f3-829f-4d57-b0a2-31c27b8453cd/kube-rbac-proxy-rules/0.log" Jul 13 18:29:47.483236 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:47.483207 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54967b65dd-qmqdh_4b7b14f3-829f-4d57-b0a2-31c27b8453cd/kube-rbac-proxy-metrics/0.log" Jul 13 18:29:49.838144 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.838116 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w"] Jul 13 18:29:49.841296 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.841275 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:49.843630 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.843599 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-td66b\"/\"default-dockercfg-c8722\"" Jul 13 18:29:49.844320 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.844304 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-td66b\"/\"openshift-service-ca.crt\"" Jul 13 18:29:49.844320 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.844317 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-td66b\"/\"kube-root-ca.crt\"" Jul 13 18:29:49.854206 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.854181 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w"] Jul 13 18:29:49.925240 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.925209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-proc\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:49.925240 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.925243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-sys\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:49.925438 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.925322 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-lib-modules\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:49.925438 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.925352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8wdq\" (UniqueName: \"kubernetes.io/projected/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-kube-api-access-w8wdq\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:49.925438 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:49.925403 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-podres\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.026748 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.026711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-proc\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.026748 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.026748 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-sys\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.027035 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.026772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-lib-modules\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.027035 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.026840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8wdq\" (UniqueName: \"kubernetes.io/projected/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-kube-api-access-w8wdq\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.027035 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.026863 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-sys\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.027035 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.026879 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-proc\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.027035 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.026902 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-lib-modules\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.027035 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.027024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-podres\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.027273 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.027170 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-podres\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.035551 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.035522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8wdq\" (UniqueName: \"kubernetes.io/projected/2f8c86bb-2d76-49e2-9032-ba8392d2b6d6-kube-api-access-w8wdq\") pod \"perf-node-gather-daemonset-mf28w\" (UID: \"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6\") " pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.151353 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.151270 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:50.286924 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.286894 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w"] Jul 13 18:29:50.290794 ip-10-0-133-129 kubenswrapper[2565]: W0713 18:29:50.290765 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2f8c86bb_2d76_49e2_9032_ba8392d2b6d6.slice/crio-7149adc209a335b517dabf3d65e5f579e1db3e7e92264fc14f914df86fe3fcfd WatchSource:0}: Error finding container 7149adc209a335b517dabf3d65e5f579e1db3e7e92264fc14f914df86fe3fcfd: Status 404 returned error can't find the container with id 7149adc209a335b517dabf3d65e5f579e1db3e7e92264fc14f914df86fe3fcfd Jul 13 18:29:50.314902 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:50.314867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" event={"ID":"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6","Type":"ContainerStarted","Data":"7149adc209a335b517dabf3d65e5f579e1db3e7e92264fc14f914df86fe3fcfd"} Jul 13 18:29:51.320751 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:51.320705 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" event={"ID":"2f8c86bb-2d76-49e2-9032-ba8392d2b6d6","Type":"ContainerStarted","Data":"3145d94bebb0b08bc23081e9d2b78facb34d61adae0fe5fc416883c0c4c86fcb"} Jul 13 18:29:51.321187 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:51.320842 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:51.339694 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:51.339652 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" podStartSLOduration=2.339637903 podStartE2EDuration="2.339637903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 18:29:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 18:29:51.338823677 +0000 UTC m=+743.011227502" watchObservedRunningTime="2026-07-13 18:29:51.339637903 +0000 UTC m=+743.012041774" Jul 13 18:29:51.807723 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:51.807696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8bx9_cde58b71-8ef9-41f1-9f4e-cb047fe19fd9/dns/0.log" Jul 13 18:29:51.834197 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:51.834174 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8bx9_cde58b71-8ef9-41f1-9f4e-cb047fe19fd9/kube-rbac-proxy/0.log" Jul 13 18:29:51.883398 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:51.883375 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kwhbc_1d7e46ee-7d9b-4e13-8ee6-bba1c9e85725/dns-node-resolver/0.log" Jul 13 18:29:52.520386 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:52.520343 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfz9c_857e09d3-4398-4d8c-8e77-5edbd13b3814/node-ca/0.log" Jul 13 18:29:53.634302 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:53.634283 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bfdc649b5-n5htj_fd306fa5-4b2c-436a-933c-9087dce172d8/kube-auth-proxy/0.log" Jul 13 18:29:53.781363 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:53.781331 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-db5sc_882fb806-4b11-4153-aff1-2f550ec28819/payload-processing/0.log" Jul 13 18:29:54.460871 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:54.460813 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4qfs_f8097181-e0f0-4857-b41e-1195f4fdebc2/konnectivity-agent/0.log" limit=1024 Jul 13 18:29:54.566181 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:54.566158 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lnn7b_f4d8d63e-f925-42f7-9669-dedec032d8c2/serve-healthcheck-canary/0.log" Jul 13 18:29:55.151357 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:55.151326 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lckkx_89cabab7-0554-4a9a-9ad5-080e910a2919/kube-rbac-proxy/0.log" Jul 13 18:29:55.174627 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:55.174568 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lckkx_89cabab7-0554-4a9a-9ad5-080e910a2919/exporter/0.log" Jul 13 18:29:55.196648 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:55.196605 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lckkx_89cabab7-0554-4a9a-9ad5-080e910a2919/extractor/0.log" Jul 13 18:29:57.335110 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:57.335080 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-td66b/perf-node-gather-daemonset-mf28w" Jul 13 18:29:57.672383 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:57.672306 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lrj54_2ea5c3a6-91a5-4bd6-a47a-238ea2d77e48/server/0.log" Jul 13 18:29:57.894885 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:57.894851 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db786db4b-z54rx_b63c570a-c8d2-4240-a792-cd49b6fe375e/manager/0.log" Jul 13 18:29:57.916045 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:57.916022 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6db786db4b-z54rx_b63c570a-c8d2-4240-a792-cd49b6fe375e/copy-manifests/0.log" Jul 13 18:29:59.299015 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:59.298983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8cf789686-vr4bn_34b2c725-1d4e-466b-a950-dce80da9884c/manager/0.log" Jul 13 18:29:59.331799 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:29:59.331776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5cxnm_9af14c7e-7b89-4efc-9a82-b5e802162b73/openshift-lws-operator/0.log" Jul 13 18:30:00.105712 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:00.105568 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bfdc649b5-n5htj_fd306fa5-4b2c-436a-933c-9087dce172d8/kube-auth-proxy/0.log" Jul 13 18:30:00.214946 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:00.214917 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-db5sc_882fb806-4b11-4153-aff1-2f550ec28819/payload-processing/0.log" Jul 13 18:30:01.429453 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:01.429422 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bfdc649b5-n5htj_fd306fa5-4b2c-436a-933c-9087dce172d8/kube-auth-proxy/0.log" Jul 13 18:30:01.588821 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:01.588805 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-db5sc_882fb806-4b11-4153-aff1-2f550ec28819/payload-processing/0.log" Jul 13 18:30:07.051926 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.051901 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t5m68_b5a13c16-11b1-4300-bd5e-a305e2c2a881/kube-multus-additional-cni-plugins/0.log" Jul 13 18:30:07.074932 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.074906 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t5m68_b5a13c16-11b1-4300-bd5e-a305e2c2a881/egress-router-binary-copy/0.log" Jul 13 18:30:07.096661 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.096632 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t5m68_b5a13c16-11b1-4300-bd5e-a305e2c2a881/cni-plugins/0.log" Jul 13 18:30:07.121717 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.121693 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t5m68_b5a13c16-11b1-4300-bd5e-a305e2c2a881/bond-cni-plugin/0.log" Jul 13 18:30:07.143703 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.143683 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t5m68_b5a13c16-11b1-4300-bd5e-a305e2c2a881/routeoverride-cni/0.log" Jul 13 18:30:07.170412 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.170387 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t5m68_b5a13c16-11b1-4300-bd5e-a305e2c2a881/whereabouts-cni-bincopy/0.log" Jul 13 18:30:07.198701 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.198677 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t5m68_b5a13c16-11b1-4300-bd5e-a305e2c2a881/whereabouts-cni/0.log" Jul 13 18:30:07.243781 ip-10-0-133-129 kubenswrapper[2565]: I0713 18:30:07.243758 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bmsqx_c29ed7f7-dd99-41f5-9b16-b71d2ce2f556/kube-multus/0.log"